R. Adamczak, A tail inequality for suprema of unbounded empirical processes with applications to Markov chains, Electronic Journal of Probability, vol.13, issue.0, pp.1000-1034, 2008.

R. Adamczak and W. Bednorz, Some remarks on MCMC estimation of spectra of integral operators, Bernoulli, vol.21, issue.4, pp.2073-2092, 2015.

P. Ango-nze, Critères d'ergodicité géométrique ou arithmétique de modèles linéaires pertubés à représentation markovienne, Comptes Rendus de l'Académie des Sciences - Series I - Mathematics, vol.326, issue.3, pp.371-376, 1998.

M. A. Arcones and E. Gine, Limit Theorems for $U$-Processes, The Annals of Probability, vol.21, issue.3, pp.1494-1542, 1993.

J. Bai, Testing Parametric Conditional Distributions of Dynamic Models, Review of Economics and Statistics, vol.85, issue.3, pp.531-549, 2003.

L. Baringhaus and N. Henze, A consistent test for multivariate normality based on the empirical characteristic function, Metrika, vol.35, issue.1, pp.339-348, 1988.

J. Beirlant, L. Györfi, and G. Lugosi, On the asymptotic normality of theL1- andL2-errors in histogram density estimation, Canadian Journal of Statistics, vol.22, issue.3, pp.309-318, 1994.

I. S. Borisov and N. V. Volodko, A note on exponential inequalities for the distribution tails of canonical von Mises? statistics of dependent observations, Statistics & Probability Letters, vol.96, pp.287-291, 2015.

C. Butucea, Goodness-of-fit testing and quadratic functional estimation from indirect observations, The Annals of Statistics, vol.35, issue.5, pp.1907-1930, 2007.
URL : https://hal.archives-ouvertes.fr/hal-00204453

A. Christmann and I. Steinwart, Support Vector Machines for Classification, Support Vector Machines, pp.285-329

K. Chwialkowski, H. Strathmann, and A. Gretton, Goodness of Fit Test, Workshop and Conference Proceedings

S. Clémençon, G. Ciolek, and P. Bertail, Concentration inequalities for regenerative and Harris recurrent Markov chains with applications to statistical learning, Séminaire généraliste de l'équipe de Probabilités et Statistiques, 2017.

S. Clémençon, G. Lugosi, and N. Vayatis, Ranking and Empirical Minimization of U-statistics, The Annals of Statistics, vol.36, issue.2, pp.844-874, 2008.

Y. De-castro and Q. Duchemin, Markov Random Geometric Graph (MRGG): A Growth Model for Temporal Dynamic Networks, 2020.
URL : https://hal.archives-ouvertes.fr/hal-02865542

Y. De-castro, C. Lacour, and T. M. Pham-ngoc, Adaptive estimation of nonparametric geometric graphs, Mathematical Statistics and Learning, vol.2, issue.3, pp.217-274, 2020.
URL : https://hal.archives-ouvertes.fr/hal-01570489

P. Del-moral and A. Guionnet, Central limit theorem for nonlinear filtering and interacting particle systems, The Annals of Applied Probability, vol.9, issue.2, pp.275-297, 1999.

R. A. Devore and G. G. Lorentz, Constructive Approximation, 1993.

P. Doukhan and M. Ghindes, Estimations dans le processus, x n+1 = f (x n ) + n, vol.291, pp.61-64, 1980.

G. Fan and Y. Ding, Statistical Machine Learning Approaches for Sports Video Mining Using Hidden Markov Models, Handbook of Research on Machine Learning Applications and Trends, pp.457-481

Y. Fan, Goodness-of-Fit Tests for a Multivariate Distribution by the Empirical Characteristic Function, Journal of Multivariate Analysis, vol.62, issue.1, pp.36-63, 1997.

Y. Fan and A. Ullah, On goodness-of-fit tests for weakly dependent processes using kernel method, Journal of Nonparametric Statistics, vol.11, issue.1-3, pp.337-360, 1999.

T. Fernández and A. Gretton, Chi-squared Test for Censored Data, Chi-squared Goodness-of-fit Tests for Censored Data, pp.31-70, 2017.

D. Ferré, L. Hervé, and J. Ledoux, Limit theorems for stationary Markov processes with L2-spectral gap, Annales de l'Institut Henri Poincaré, Probabilités et Statistiques, vol.48, issue.2, pp.396-423, 2012.

G. Fort, E. Moulines, P. Priouret, and P. Vandekerkhove, A simple variance inequality for -statistics of a Markov chain with applications, Statistics & Probability Letters, vol.82, issue.6, pp.1193-1201, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00608574

M. Fromont and B. Laurent, Adaptive goodness-of-fit tests in a density model, The Annals of Statistics, vol.34, issue.2, pp.680-720, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00457755

E. Giné and R. Nickl, Mathematical foundations of infinite-dimensional statistical models, vol.40, 2016.

E. Giné, R. Lata?a, and J. Zinn, Exponential and Moment Inequalities for U-Statistics, High Dimensional Probability II, vol.II, pp.13-38, 2000.

J. Gorham and L. Mackey, Measuring sample quality with kernels, Proceedings of the 34th International Conference on Machine Learning, vol.70, pp.1292-1301, 2017.

Z. Guo, Y. Ying, and D. Zhou, Online regularized learning with pairwise loss functions, Advances in Computational Mathematics, vol.43, issue.1, pp.127-150, 2016.

F. Han, An Exponential Inequality for U-Statistics Under Mixing Conditions, Journal of Theoretical Probability, vol.31, issue.1, pp.556-578, 2016.

C. Houdré and P. Reynaud-bouret, Exponential Inequalities, with Constants, for U-statistics of Order Two, Stochastic Inequalities and Applications, pp.55-69, 2003.

Y. I. Ingster, Minimax Testing of a Simple Hypothesis Against a Weakly Nonparametric Set of Alternatives, Theory of Probability & Its Applications, vol.33, issue.3, pp.552-556, 1989.

B. Jiang, Q. Sun, F. , and J. , Preprint repository arXiv achieves milestone million uploads, Physics Today, 2014.

E. Joly and G. Lugosi, Robust estimation of U-statistics, Stochastic Processes and their Applications, pp.3760-3773, 2016.

G. L. Jones, On the Markov chain central limit theorem, Probability Surveys, vol.1, issue.0, pp.299-320, 2004.

V. Koltchinskii, E. Giné, and E. Gine, Random Matrix Approximation of Spectra of Integral Operators, Bernoulli, vol.6, issue.1, p.113, 2000.

S. Kwapie? and W. A. Woyczy?ski, Multiple Stochastic Integrals, Random Series and Stochastic Integrals: Single and Multiple, pp.277-305, 1992.

M. Lerasle, N. M. Magalhães, and P. Reynaud-bouret, Optimal Kernel Selection for Density Estimation, High Dimensional Probability VII, pp.425-460, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01224097

F. Li and G. Tkacz, A consistent bootstrap test for conditional density functions with time-series data, Journal of Econometrics, vol.133, issue.2, pp.863-886, 2006.

F. Lindsten, R. Douc, and E. Moulines, Uniform Ergodicity of the Particle Gibbs Sampler, Scandinavian Journal of Statistics, vol.42, issue.3, pp.775-797, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01257066

Q. Liu, J. Lee, J. , and M. , Power Comparison of Some Goodness-of-fit Tests, International conference on machine learning, pp.276-284

P. Massart, Concentration Inequalities and Model Selection, vol.6, 2007.

K. L. Mengersen and R. L. Tweedie, Rates of convergence of the Hastings and Metropolis algorithms, The Annals of Statistics, vol.24, issue.1, pp.101-121, 1996.

S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability, vol.92, 1993.

C. Müller, Analysis of Spherical Symmetries in Euclidean Spaces, vol.129, 1998.

D. Paulin, Concentration inequalities for Markov chains by Marton couplings and spectral methods, Electronic Journal of Probability, vol.20, issue.0, p.20, 2015.

G. Pisier, Some applications of the metric entropy condition to harmonic analysis, Banach Spaces, Harmonic Analysis, and Probability Theory, pp.123-154, 1983.

Q. Qin, J. P. Hobert, and K. Khare, Estimating the spectral gap of a trace-class Markov operator, Electronic Journal of Statistics, vol.13, issue.1, pp.1790-1822, 2019.

G. O. Roberts and J. S. Rosenthal, General state space Markov chains and MCMC algorithms, Probability Surveys, vol.1, issue.0, pp.20-71, 2004.

R. Rockafellar, Convex Analysis. Princeton Landmarks in Mathematics and Physics, 1970.

R. Rudzkis and A. Bakshaev, Goodness of Fit Tests Based on Kernel Density Estimators, Informatica, vol.24, issue.3, pp.447-460, 2013.

Y. Shen, F. Han, and D. Witten, Exponential inequalities for dependent V-statistics via random Fourier features, Electronic Journal of Probability, vol.25, issue.0, p.25, 2020.

S. Smale and D. Zhou, ONLINE LEARNING WITH MARKOV SAMPLING, Analysis and Applications, vol.07, issue.01, pp.87-113, 2009.

I. Steinwart, D. Hush, and C. Scovel, Learning from dependent observations, Journal of Multivariate Analysis, vol.100, issue.1, pp.175-194, 2009.

M. A. Suchard, R. E. Weiss, and J. S. Sinsheimer, Bayesian Selection of Continuous-Time Markov Chain Evolutionary Models, Molecular Biology and Evolution, vol.18, issue.6, pp.1001-1013, 2001.

R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction, 2011.

. Van-der, A. Vaart, and J. Wellner, Weak Convergence and Empirical Processes: With Applications to Statistics, Springer Series in Statistics, 2013.

M. J. Wainwright, High-Dimensional Statistics, vol.48, 2019.

J. Xu, Y. Y. Tang, B. Zou, Z. Xu, L. Li et al., The generalization ability of online SVM classification based on Markov sampling, IEEE transactions on neural networks and learning systems, vol.26, pp.628-639, 2014.

B. Zou, H. Zhang, and Z. Xu, Learning from uniformly ergodic Markov chains, Journal of Complexity, vol.25, issue.2, pp.188-200, 2009.