Internship
AI/ML Engineer
May 2025 - August 2025
- Core LLM Inference Engine Team, focused on LLM inference optimization, holding inference engine for all AGI products
- Implemented LLM stop word and DRY repetition penalty in Nvidia TensorRT-LLM with Triton server in Python, C++ and Cuda
- Followed CI/CD workflow, using tools like Dockers, and AWS, and learnt about new attention and KV cache mechanisms
- Largely saved LLM's cost under stop word condition and improve user experience by generating useful answers
Software Development Engineer
July 2023 - September 2023
- Developed software with Python and SQL to assist in sifting through key user data with specific tags, time intervals, and frequencies
- Developed scripts to accurately calculate the proportion of log information for each module in business to optimize log information
- Applied Tkinter for GUI, Pandas and Numpy for analysis, Base64 for encoding & decoding, and PyInstaller for bundling application
- Improved data accuracy for each branch by 30~70% and effectively reduced debugging info loss by around 40%
Full-Stack Engineer
June 2022 - August 2022
- Developed advanced AI plant disease diagnosis algorithms improved from yolov5 algorithms with Python
- Integrated the algorithm into a smart planting website using Django Model-Template-View structure
- Enhanced user interaction by allowing clients to upload data and use camera with forms, with customization options for accuracy and scope of plant disease results
- Created a company project on GitHub, synchronizing work progress with the team, and led the team to further optimize the website
Data Analyst
December 2020 - January 2021
- Gathered key financial data from Bloomberg and conducted data analysis using SQL, enhancing my analytical and modeling skills
- Analyzed research reports on ROE and growth of SaaS companies to provide supportive info for investment decisions in the industry
- Retrieved relevant data of corporations from database, made excel, designed, and implemented functions to predict stock price trend