Publications

My Google Scholar Page

Book Chapters

• J.-S. Pang and M. Razaviyayn, “A Unified Distributed Algorithms for Non-Cooperative Games,” in Big Data over Networks, S. Cui, A. Hero, Z.-Q. Luo, and J. M. F. Moura, Editors, Cambridge Univ. Press, 2015

Patents

• M. Razaviyayn, H. Baligh, A. Callard, and Z.-Q. Luo, “System and Method for Transceiver Design,” US patent, 2012
• Z.-Q. Luo, H. Baligh, and M. Razaviyayn, “System and Method for Transceivers in a Wireless Network,” US patent, 2013
• M. Razaviyayn, H. Baligh, A. Callard, and Z.-Q. Luo, “Robust Transceiver Design,” US patent, 2013
• R. Sun, M. Hong, M. Baligh, Z.-Q. Luo, and M. Razaviyayn, “System and Method for Transmission Point (TP) Association and Beamforming Assignment in Heterogeneous Networks,” US patent, 2013

Journal and Conference Publications:

2021:

• M. Nouiehed and M. Razaviyayn, “Learning Deep Models: Critical Points and Local Openness”, Accepted in INFORMS Journal on Optimization, available at arxiv:1803.02968, 2021.
• D. Ostrovskii, A. Lowy, M. Razaviyayn, “Efficient Search of First-Order Nash Equilibria in Nonconvex-Concave Smooth Min-Max Problems”, Accepted in SIAM Journal on Optimization, 2021.
• S. Lu, J. D. Lee, M. Razaviyayn, M. Hong, “Linearized ADMM Converges to Second-Order Stationary Points for Non-Convex Problems,” IEEE Transactions on Signal Processing, 2021.
• A. Lowy and M. Razaviyayn “Locally Differentially Private Federated Learning: Efficient Algorithms with Tight Risk Bounds,” submitted, available at arXiv:2106.09779, 2021.
• T. Huang, P. Singhania, M. Sanjabi, P. Mitra, and M. Razaviyayn, “Alternating direction method of multipliers for quantization,” In International Conference on Artificial Intelligence and Statistics, pp. 208-216. PMLR, 2021.
• A. Lowy, R. Pavan, S. Baharlouei, M. Razaviyayn, and A. Beirami. “FERMI: Fair Empirical Risk Minimization via Exponential Rényi Mutual Information,” submitted, available at arXiv:2102.12586, 2021.
• A. Lowy and M. Razaviyayn, “Output Perturbation for Differentially Private Convex Optimization with Improved Population Loss Bounds, Runtimes and Applications to Private Adversarial Training,” Submitted, available at arXiv:2102.04704, 2021.
• D. M. Ostrovskii, M. Ndaoud, A. Javanmard, and M. Razaviyayn, “Near-Optimal Model Discrimination with Non-Disclosure,” Submitted, available at arXiv:2012.02901.

2020:

• M. Nouiehed and M. Razaviyayn, “A Trust Region Method for Finding Second-Order Stationarity in Linearly Constrained Non-Convex Optimization,” SIAM Journal on Optimization, vol. 30, 2501-2529, 2020.
• M. Hong, T. H. Chang, X. Wang,  M. Razaviyayn, S. Ma, and Z.-Q. Luo, “A block successive upper bound minimization method of multipliers for linearly constrained convex optimization,” Mathematics of Operations Research, 45(3), 833-861.
• M. Razaviyayn, S. Lu, M. Nouiehed, T. Huang, M. Sanjabi, and M. Hong, “Non-convex Min-Max Optimization: Applications, Challenges, and Recent Theoretical Advances,” IEEE Signal Processing Magazine, 2020.
• H. Mohammadi, M. Razaviyayn, and M. R. Jovanović, “Variance Amplification of Accelerated First-Order Methods for Strongly Convex Optimization Problems,” IEEE Transactions on Automatic Control, 2020.
• Z. I. Chowdhury, M. Zabihi, S. K. Khatamifard, Z. Zhao, S. Resch, M. Razaviyayn, J.-P. Wang, S. S. Sapatnekar, and U. R. Karpuzcu. “A DNA read alignment accelerator based on computational ram,” IEEE Journal on Exploratory Solid-State Computational Devices and Circuits vol. 6, no. 1, 80–88, 2020.
• S. Lu, M. Razaviyayn, B. Yang, K. Huang, and M. Hong, “SNAP: Finding Approximate Second-Order Stationary Solutions Efficiently for Non-convex Linearly Constrained Problems,” Spotlight Presentation in NeurIPS 2020, [acceptance rate for spotlight presentations: 3%].
• S. Baharlouei, M. Nouiehed, and M. Razaviyayn, “Rényi Fair Inference,” International Conference on Learning Representation (ICLR), 2020.
• B. Barazandeh and M. Razaviyayn, “Solving Non-convex Non-differentiable Min-Max Games Using Proximal Gradient Method,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020.

 

2019:

• M. Hong, T.-H. Chang, X. Wang, M. Razaviyayn, S. Ma and Z.-Q. Luo. “A Block Successive Upper Bound Minimization Method of Multipliers for Linearly Constrained Convex Optimization,” Mathematics of Operations Research, 2019.
• M. Razaviyayn, M. Hong, N. Reyhanian, Z.-Q. Luo. “A Doubly Stochastic Gauss-Seidel Algorithm for Solving Linear Equations and Certain Convex Minimization Problems,” Mathematical Programming, vol. 176, 465–496, 2019.
• M.Nouiehed, J.-S.Pang, and M.Razaviyayn, “On the Pervasiveness of Difference-Convexity in Optimization and Statistics,” Math Programming Series B, vol. 174, 195–222, 2019.
• M. Nouiehed, M. Sanjabi, T. Huang, J. D. Lee, and M. Razaviyayn “Solving a Class of Non-Convex Min-Max Games UsingIterative First-Order Methods,” Neural Information Processing Systems (NeurIPS), 2019.
• B. Barazandeh, M. Sanjabi, and M. Razaviyayn, “Training Generative Adversarial Networks Using Randomly Generated Discriminators,” IEEE Data Science Workshop, 2019 [won the best paper award].
• H. Mohammadi, M. Razaviyayn, and M. Jovanović, “Performance of Noisy Nesterov’s Accelerated Method for Strongly Convex Optimization Problems,” IEEE American Control Conference (ACC), pp. 3426-3431, 2019.

2018:

• M. Nouiehed and M. Razaviyayn, “Learning Deep Models: Critical Points and Local Openness”, in preparation, 2017.
• H. Mohammadi, M. Razaviyayn, and M. R. Jovanović, “Variance Amplification of Accelerated First-Order Algorithms for Strongly Convex Quadratic Optimization Problems,”  IEEE Conference on Decision and Control (CDC), pp. 5753-5758, 2018.
• A. Aubry, A. De Maio, A. Zappone, M. Razaviyayn, and Z.-Q. Luo, “A New Sequential Optimization Procedure and its Applications to Resource Allocation for Wireless Systems,” IEEE Transactions on Signal Processing, 66(24), pp. 6518-6533, 2018.
• M. Razaviyayn, M. Hong, M. Reyhanian, and Z.-Q. Luo, “A Doubly Stochastic Gauss-Seidel Algorithm for Solving Linear Equations and Certain Convex Minimization Problems,” submitted, available at arXiv:1810.05251, 2018.
• M. Nouiehed, M. Razaviyayn, and J. D. Lee, “Convergence to Second-Order Stationarity for Constrained Non-Convex Optimization,” submitted, available at arXiv:1810.02024, 2018.
• B. Barazandeh and M. Razaviyayn, “On the Behavior of the Expectation-Maximization Algorithm for Mixture Models,” IEEE Global Conference on Signal and Information Processing (GlobalSip), 2018.
• H. Mohammadi, M. Razaviyayn, and M. R. Jovanović, “On the Stability of Gradient Flow Dynamics for a Rank-One Matrix Approximation Problem,” IEEE Annual American Control Conference (ACC), pp. 4533-4538, 2018.
• M. Hong, M. Razaviyayn, and J. D. Lee, “Gradient Primal-Dual Algorithm Converges to Second-Order Stationary Solution for Nonconvex Distributed Optimization Over Networks,” In International Conference on Machine Learning (ICML), 2018.
• M. J. Zhang, M. Razaviyayn, and D. Tse, “Minimax Optimality of Sign Test for Paired Heterogeneous Data”, submitted available at arXiv:1801.04005, 2018.
• M. Sanjabi, J. Ba, M. Razaviyayn, and J. D. Lee, “On the Convergence and Robustness of Training GANs with Regularized Optimal Transport”, Advances in Neural Information Processing Systems (NeurIPS), pp. 7091-7101, 2018.
• M. Nouiehed, J.-S. Pang, and M. Razaviyayn. “On the Pervasiveness of Difference-Convexity in Optimization and Statistics,” Math Programming Series B, pp. 1-28, 2018.

2017:

• Q. Shi, M. Razaviyayn, M. Hong, Z.-Q. Luo, “SINR Constrained Beamforming for a MIMO Multi-user Downlink System,” IEEE Transactions on Signal Processing, 2016.
• J.-S. Pang, M. Razaviyayn, and A. Alvarado “Computing B-Stationary Points of Nonsmooth DC Programs,” Mathematics of Operations Research, 2016.
• M. Razaviyayn, M. Hong, Z.-Q. Luo, J.-S. Pang, “A Unified Algorithmic Framework for Block-Structured Optimization Involving Big Data,” IEEE Signal Processing Magazine, 2016.
• M. Razaviyayn, M. Sanjabi, and Z.-Q. Luo, “Stochastic Successive Minimization Method for Nonsmooth Nonconvex Optimization with Applications to Transceiver Design in Wireless Communication Networks”, Mathematical Programming Series B, 2016.
• M. Hong, Z.-Q. Luo, and M. Razaviyayn, “Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problems,” SIAM Journal on Optimization, 2016.
• M. Razaviyayn, F. Farnia, and D. Tse, “Inference and Feature Selection via Maximal Correlation,” Advances in Neural Information Processing Systems (NIPS), 2015.
• F. Farnia, M. Razaviyayn, S. Kannan, and D. Tse, “Minimum HGR Correlation Principle: From Marginals to Joint Distribution,” IEEE International Symposium on Information Theory (ISIT), 2015.
• M. Razaviyayn, M. Hong, Z.-Q. Luo, and J.-S. Pang, “Parallel Successive Convex Approximation for Nonsmooth Nonconvex Optimization,” Advances in Neural Information Processing Systems (NIPS), 2014.
• M. Sanjabi, M. Hong, M. Razaviyayn, and Z.-Q. Luo, “Joint Base Station Clustering and Beamformer Design for Partial Coordinated Transmission using Statistical Channel State Information,” Signal Processing Advances in Wireless Communications (SPAWC), 2014.
• M. Hong, T.-H. Chang, X. Wang, M. Razaviyayn, S. Ma, and Z.-Q. Luo, “A Block Coordinate Descent Method of Multipliers: Convergence Analysis and Applications,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2014.
• M. Razaviyayn, H.-W. Tseng, and Z.-Q. Luo, “Dictionary Learning for Sparse Representation: Complexity and Algorithms,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2014.
• X. Wang, M. Hong, T.-H. Chang, M. Razaviyayn, and Z.-Q. Luo, “Joint Day-Ahead Power Procurement and Load Scheduling Using Stochastic Alternating Direction Method of Multipliers,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2014.
• H. Baligh, M. Hong, W. C. Liao, Z.-Q. Luo, M. Razaviyayn, M. Sanjabi, and R. Sun, “Cross-Layer Provision of Future Cellular Networks: A WMMSE-based approach,” IEEE Signal Processing Magazine, 31(6), 56-68, 2014. (Authors are in alphabetical order)
• M. Sanjabi, M. Razaviyayn, and Z.-Q. Luo, “Optimal Joint Base Station Assignment and Beamforming for Heterogeneous Networks,” IEEE Transactions on Signal Processing, 62(8), 1950-1961, 2014.
• M. Razaviyayn, H. Baligh, A. Callard, and Z.-Q. Luo, “Joint User Grouping and Transceiver Design in a MIMO Interfering Broadcast Channel,” IEEE Transactions on Signal Processing, 62(1), 85-94, 2014.
• M. Hong, Z. Xu, M. Razaviyayn, and Z.-Q. Luo, “Joint User Grouping and Linear Virtual Beamforming: Complexity, Algorithms and Approximation Bounds,” IEEE Journal on Selected Areas in Communications, 31(10), 2013.
• M. Razaviyayn, M. Hong, and Z.-Q. Luo, “A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization,” SIAM Journal on Optimization, 23(2), 1126-1153, 2013.
• M. Razaviyayn, M. Hong, and Z.-Q. Luo, “Linear Transceiver Design for a MIMO Interfering Broadcast Channel Achieving Max–Min Fairness,” Signal Processing, 93(12), 3327-3340, 2013.
• M. Razaviyayn, M. Sanjabi, and Z.-Q. Luo, “A Stochastic Weighted MMSE Approach to Sum Rate Maximization for a MIMO Interference Channel,” Signal Processing Advances in Wireless Communications (SPAWC), 2013.
• M. Hong, M. Razaviyayn, R. Sun, and Z.-Q. Luo, “Joint Transceiver Design and Base Station Clustering for Heterogeneous Networks,” Asilomar Conference on Signals, Systems, and Computers, 2012 (invited).
• Q. Shi, M. Razaviyayn, M. Hong, and Z.-Q. Luo, “SINR Constrained Beamforming for a MIMO Multi-user Downlink System,” Asilomar Conference on Signals, Systems, and Computers, 2012 (invited).
• M. Sanjabi, M. Razaviyayn, Z.-Q. Luo, “Optimal Joint Base Station Assignment and Downlink Beamforming for Heterogeneous Networks,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2012.
• M. Razaviyayn, M. Sanjabi, and Z.-Q. Luo, “Linear Transceiver Design for Interference Alignment: Complexity and Computation,” IEEE Transactions on Information Theory, 58(5), 2896-2910, 2012.
• M. Razaviyayn, G. Lyubeznik, and Z.-Q. Luo, “On the Degrees of Freedom Achievable Through Interference Alignment in a MIMO Interference Channel,” IEEE Transactions on Signal Processing, 60(2), 812-821, 2012.
• Q. Shi, M. Razaviyayn, Z.-Q. Luo, and C. He, “An Iteratively Weighted MMSE Approach to Distributed Sum-Utility Maximization for a MIMO Interfering Broadcast Channel,” IEEE Transactions on Signal Processing, 59(9), 4331-4340, 2011.
• M. Razaviyayn, M. Hong, and Z.-Q. Luo, “Linear Transceiver Design for a MIMO Interfering Broadcast Channel Achieving Max-Min Fairness,” Asilomar Conference on Signals, Systems, and Computers, 2011, (invited).
• M. Razaviyayn, H. Baligh, A. Callard, Z.-Q. Luo, “Joint Transceiver Design and User Grouping in a MIMO Interfering Broadcast Channel,” 45th Conference on Information Sciences and Systems, 2011.
• Q. Shi, M. Razaviyayn, Z.-Q. Luo, C. He, “An Iteratively Weighted MMSE Approach to Distributed Sum-Utility Maximization for a MIMO Interfering Broadcast Channel,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2011.
• J. Lei, M. Razaviyayn, E. Song, Z.-Q. Luo, F. Y. Li “Power Allocation in Multi-Channel Cognitive Radio Networks with Channel Assembling,” Signal Processing Advances in Wireless Communications (SPAWC), 2011.
• M. Razaviyayn, G. Lyubeznik, and Z.-Q. Luo, “On the Degrees of Freedom Achievable Through Interference Alignment in a MIMO Interference Channel,” Signal Processing Advances in Wireless Communications (SPAWC), 2011.
• M. Razaviyayn, Z.-Q. Luo, P. Tseng, and J.-S. Pang, “A Stackelberg Game Approach to Distributed Spectrum Management,” Mathematical Programming, 129(2), 197-224, 2011.
• M. Razaviyayn, Y. H. Morin, and Z.-Q. Luo, “A Stackelberg Game Approach to Distributed Spectrum Management,” International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2010.
• M. Razaviyayn, M. S. Boroujeni, Z.-Q. Luo, “Linear Transceiver Design for Interference Alignment: Complexity and Computation,” Signal Processing Advances in Wireless Communications (SPAWC), 2010 (Shortlisted for SPAWC 2010s Best Student Paper Award).