4.3 Read 24 reviews
Overview
Fine-tuning has become a popular approach to adapting large foundational models to specific tasks. As the size of models and datasets grows, parameter-efficient fine-tuning techniques are increasingly important. One of the most widely used methods is Low-Rank Adaptation (LoRA), with adaptation update expressed as the product of two low-rank matrices.
While LoRA was shown to possess strong performance in fine-tuning, it often under-performs when compared to full-parameter fine-tuning (FPFT). Although many variants of LoRA have been extensively studied empirically, their theoretical optimization analysis is heavily under-explored. Discover more with this Fine-Tuning of Foundation Models via Low-Rank Adaptation and Beyond (Internship) project at King Abdullah University of Science and Technology (KAUST) .
Recommended Student Background
- Machine Learning
- AI
- Computer Science
Get more details
Visit programme websiteProgramme Structure
The goals of this project:
- Propose and evaluate (e.g., theoretically or empirically analyze) new fine-tuning methods, improving upon LoRA and other recently proposed FPFT methods
- Write a paper describing the new results, and submit it to a leading AI/ML conference, such as NeurIPS, ICML or ICLR
Check out the full curriculum
Visit programme websiteKey information
Duration
- Part-time
- 3 months
Start dates & application deadlines
You can apply for and start this programme anytime.
More details
- Application deadline: all year around
Language
English
PTE Academic 62
IELTS 6.5
Prepare for Your English Test
Cathoven AI IELTS Preparation AI-powered IELTS feedback. Clear, actionable, and tailored to boost your writing & speaking score. No credit card or upfront payment required.
- Trusted by 300k learners
- 98 accuracy using real exam data
- 4.9/5 student rating
Delivered
On Campus
Campus Location
- Thuwal, Saudi Arabia
Disciplines
Mathematics Computer Sciences Machine Learning View 61 other Short Courses in Computer Sciences in Saudi ArabiaExplore more key information
Visit programme websiteWhat students do after studying
Join for free or log in to access our complete career info list.
Academic requirements
GPA 3.5
English requirements
PTE Academic 62
IELTS 6.5
Prepare for Your English Test
Cathoven AI IELTS Preparation AI-powered IELTS feedback. Clear, actionable, and tailored to boost your writing & speaking score. No credit card or upfront payment required.
- Trusted by 300k learners
- 98 accuracy using real exam data
- 4.9/5 student rating
Other requirements
General requirements
- Undergraduate students in 3rd year or above and master’s students.
- Minimum GPA: 3.5/4
- Curriculum Vitae (CV)
- Statement of purpose
- Contact details of 3 referees
- Official English language test score
Student Insurance via Studyportals Partner
Make sure to cover your health, travel, and stay while studying abroad. Even global coverages can miss important items like Additional medical costs, Repatriation, Liability etc. Make sure your student insurance covers your needs.
Studyportals partnered with Aon to provide you with the best affordable student insurance, for a carefree experience away from home.
Get your student insurance nowStarting from €0.53/day, free cancellation any time.
Remember, countries and universities may have specific insurance requirements. To learn more about how student insurance work at King Abdullah University of Science and Technology (KAUST) and/or in Saudi Arabia, please visit Student Insurance Portal.
Make sure you meet all requirements
Visit programme websiteTuition Fees
Tuition fees are shown in and the most likely applicable fee is shown based on your nationality.
-
International Applies to you
Applies to youNon-residentsFree -
Domestic Applies to you
Applies to youCitizens or residentsFree
Additional Details
- This is a fully-funded internship; it includes tuition, airfare, housing, medical insurance, visa reimbursement and a monthly stipend of $1,000.
Living costs
Thuwal
Saudi Arabia
2270 - 3445 SAR / month
The living costs include the total expenses per month, covering accommodation, public transportation, utilities (electricity, internet), books and groceries.
Funding
Improve page content