Welcome! I am an Assistant Professor at the Department of Computer Science in National Yang Ming Chiao Tung University. My research focuses on multi-armed bandits, reinforcement learning, Bayesian optimization, meta learning, and stochastic optimization for networks. For more details, please see Initiatives.
[Oct. 2021] Two papers are accepted to NeurIPS 2021! The titles are "Reinforced Few-Shot Acquisition Function Learning for Bayesian Optimization" and "NeurWIN: Neural Whittle Index Network for Restless Bandits via Deep RL." Congratulations to our group member Bing-Jing Hsieh (謝秉瑾)!
[Oct. 2021] I gave a talk at TAAI AI Forum 2021, and the title is "Exploration Through Reward Biasing: Bandit Learning via Reward-Biased Maximum Likelihood Estimation."
[Sept. 2021] I gave a talk at the Institute of Neuroscience in NYCU, and the topic is "Rethinking Policy Improvement in Reinforcement Learning: Two Case Studies."
[Jun. 2021] Our undergraduate group member Cheng-Yu Chung (鍾承佑) (along with his teammates Bing-Zhi Ke (柯秉志) and Yu-Lun Hsu (徐煜倫)) is awarded the MOST Research Grant for University Students. Congratulations!
[May. 2021] Our paper, "Escaping from Zero Gradient: Revisiting Action-Constrained Reinforcement Learning via Frank-Wolfe Policy Optimization," is accepted to UAI 2021! Congratulations to our group members Jyun-Li Lin (林峻立), Wei Hung (洪偉), and Shang-Hsuan Yang (楊上萱)!
[Apr. 2021] I gave a talk at the Department of Computer Science in NTNU, and the talk is on "Reinforcement Learning and Bandits: Two Case Studies."
[Dec. 2020] A paper, "Reward-Biased Maximum Likelihood Estimation for Linear Stochastic Bandits," is accepted to AAAI 2021! Congratulations to our group member Yu-Heng Hung (洪鈺恆)!
[Oct. 2020] Our paper, "Fresher Content or Smoother Playback? A Brownian-Approximation Framework for Scheduling Real-Time Wireless Video Streams," received the Best Paper Award from MobiHoc 2020!
[Oct. 2020] Our paper, "Rethinking Deep Policy Gradient via State-Wise Policy Improvement," is accepted to ICBINB Workshop @ NeurIPS 2020.
[Jun. 2020] Our paper, "Exploration Through Reward Biasing: Reward-Biased Maximum Likelihood Estimation for Stochastic Multi-Armed Bandits ", is accepted to ICML 2020!
[Apr. 2020] A paper, "Fresher Content or Smoother Playback? A Brownian-Approximation Framework for Scheduling Real-Time Wireless Video Streams," is accepted to MobiHoc 2020!
[Dec. 2019] I gave a talk at Academia Sinica and the Department of Communication Engineering in NTPU on "Bandit Learning: Optimality, Scalability, and Reneging."
[Jun. 2019] I attended ICML 2019 in Long Beach, CA ang gave a presentation on "Stay With Me: Lifetime Maximization Through Heteroscedastic Linear Bandits With Reneging."
[Apr. 2019] A paper, "Stay With Me: Lifetime Maximization Through Heteroscedastic Linear Bandits With Reneging," is accepted to ICML 2019!
[Feb. 2019] I am awarded the Young Scholar Fellowship (愛因斯坦計畫) from Ministry of Science and Technology (MOST) in Taiwan.
[Nov. 2018] I gave a talk at the CS Department in NCTU on "Providing Ultra-Low Latency for Wireless Networks: From Theory to Practice."
[Nov. 2018] I gave a talk at the TAMU ECE seminar on "PULS: Processor-Supported Ultra-Low Latency Scheduling."
[Jun. 2018] A paper, "Heavy-Traffic Analysis of QoE Optimality for On-Demand Video Streams Over Fading Channels," is accepted to IEEE/ACM Transactions on Networking.
[May. 2018] I attended ICC 2018 in Kansas City, MO and gave a presentation on "An Experimental Study on Coverage Enhancement of LTE Cat-M1 for Machine-Type Communication."
[May. 2018] I passed my final defense and received my Ph.D. degree from ECE at TAMU. The thesis titile is "Network Algorithms for Control and Communication for IoT Applications."
[Apr. 2018] A paper, "A Decentralized Medium Access Protocol for Real-Time Wireless Ad Hoc Networks With Unreliable Transmissions," is accepted to IEEE ICDCS 2018.
[Mar. 2018] A paper, "PULS: Processor-Supported Ultra-Low Latency Scheduling," is accepted to ACM MobiHoc 2018.
[Feb. 2018] I attended the ITA Workshop in San Diego, CA and gave an invited presentation at the Graduation Day session on "Throughput-Optimal Scheduling for Multi-Hop Networked Transportation Systems With Switch-Over Delay."