High Dimensional LDA
July 15, 2019
Global data association for MOT using network flows
July 10, 2019
This note is based on Li Zhang, Yuan Li, & Nevatia, R. (2008). Global data association for multi-object tracking using network flows. 2008 IEEE Conference on Computer Vision and Pattern Recognition, 1–8.
TreeClone
July 08, 2019
Minimax Lower Bounds
June 28, 2019
This note is based on Chapter 15 of Wainwright, M. (2019). High-Dimensional Statistics: A Non-Asymptotic Viewpoint (Cambridge Series in Statistical and Probabilistic Mathematics). Cambridge: Cambridge University Press.
Bayesian Conjugate Gradient Method
June 27, 2019
This note is for Cockayne, J., Oates, C. J., Ipsen, I. C. F., & Girolami, M. (2018). A Bayesian Conjugate Gradient Method. Bayesian Analysis.
Surprises in High-Dimensional Ridgeless Least Squares Interpolation
June 24, 2019
This post is based on Hastie, T., Montanari, A., Rosset, S., & Tibshirani, R. J. (2019). Surprises in High-Dimensional Ridgeless Least Squares Interpolation. 53.
Medicine Meets AI
June 23, 2019
Last two days, I attended the conference Medicine Meets AI 2019: East Meets West, which help me know more AI from the industrial and medical perspective.
Change Points
May 28, 2019
M-estimator
May 09, 2019
Fourier Series
May 07, 2019
The General Decision Problem
May 06, 2019
This note is based on Chapter 1 of Lehmann EL, Romano JP. Testing statistical hypotheses. Springer Science & Business Media; 2006 Mar 30.
Self-normalized Limit Theory and Stein's Method
May 01, 2019
This note consists of the lecture material of STAT 6060 taught by Prof. Shao, four homework (indexed by “Homework”) and several personal comments (indexed by “Note”).
Identifiability and Estimability
April 20, 2019
Materials from STAT 5030.
Least Squares for SIMs
April 15, 2019
In the last lecture of STAT 5030, Prof. Lin shared one of the results in the paper, Neykov, M., Liu, J. S., & Cai, T. (2016). L1-Regularized Least Squares for Support Recovery of High Dimensional Single Index Models with Gaussian Designs. Journal of Machine Learning Research, 17(87), 1–37., or say the start point for the paper—the following Lemma. Because it seems that the condition and the conclusion is completely same with Sliced Inverse Regression, except for a direct interpretation—the least square regression.
Statistical Inference for Lasso
April 15, 2019
This note is based on the Chapter 6 of Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical Learning with Sparsity. 362..
Multiple Tracking with Rao-Blackwellized marginal particle filtering
April 10, 2019
Normalizing Constant
April 10, 2019
Larry discussed the normalizing constant paradox in his blog.
Methods for Cell Tracking
April 09, 2019
This post is for the survey paper, Meijering, E., Dzyubachyk, O., & Smal, I. (2012). Chapter nine - Methods for Cell and Particle Tracking. In P. M. conn (Ed.), Methods in Enzymology (pp. 183–200).
Tracking Multiple Interacting Targets via MCMC-MRF
April 09, 2019
Subgradient
April 08, 2019
This post is mainly based on Hastie et al. (2015), and incorporated with some materials from Watson (1992).
Wierd Things in Mixture Models
April 04, 2019
This note is based on Larry’s post, Mixture Models: The Twilight Zone of Statistics.
Coupled Minimum-Cost Flow Cell Tracking
April 02, 2019
Soft Imputation in Matrix Completion
April 01, 2019
This post is based on Chapter 7 of Statistical Learning with Sparsity: The Lasso and Generalizations, and I wrote R program to reproduce the simulations to get a better understanding.
Frequentist Accuracy of Bayesian Estimates
March 31, 2019
This note is for Efron’s slide: Frequentist Accuracy of Bayesian Estimates, which is recommended by Larry’s post: Shaking the Bayesian Machine.
FARM-Test
March 29, 2019
Multiple Object Tracking
March 26, 2019
This note is for Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., Zhao, X., & Kim, T.-K. (2014). Multiple Object Tracking: A Literature Review. ArXiv:1409.7618 [Cs].
Theoretical Results of Lasso
March 26, 2019
Prof. Jon A. WELLNER introduced the application of a new multiplier inequality on lasso in the distinguish lecture, which reminds me that it is necessary to read more theoretical results of lasso, and so this is the post, which is based on Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical Learning with Sparsity. 362.
Joint Summarized by Marginal or Conditional?
March 25, 2019
I happened to read Yixuan’s blog about a question related to the course Statistical Inference, whether two marginal distributions can determine the joint distribution. The question is adopted from Exercise 4.47 of Casella and Berger (2002).
Convergence rates of least squares
March 25, 2019
This note is for Han, Q., & Wellner, J. A. (2017). Convergence rates of least squares regression estimators with heavy-tailed errors.
Generalized Gradient Descent
March 20, 2019
I read the topic in kiytay’s blog: Proximal operators and generalized gradient descent, and then read its reference, Hastie et al. (2015), and write some program to get a better understanding.