4.2 Read 23 reviews
Overview
The training data is distributed across the memory of the nodes of the system, and in each step of the training process one needs to aggregate updates computed by all nodes using local data. This aggregation step requires communication of a large tensor, which is the bottleneck limiting the efficiency of the training method.
Key Facts
To mitigate this issue, various compression (e.g., sparsification/quantization/dithering) schemes were propose in the literature recently. However, many theoretical, system-level and practical questions remain to be open.
In this Gradient Compression for Distributed Training of Machine Learning Models (Internship) project at King Abdullah University of Science and Technology (KAUST) the intern will aim to advance the state of the art in some aspect of this field. As this is a fast moving field, details of the project will only be finalized together with the successful applicant.
Get more details
Visit programme websiteProgramme Structure
Ideally author or coauthor a research paper, and submit it to a premier conference in the field (e.g., ICML, AISTATS, NeurIPS, ICLR).
Check out the full curriculum
Visit programme websiteKey information
Duration
- Part-time
- 3 months
Start dates & application deadlines
You can apply for and start this programme anytime.
More details
- Application deadline: All year around to keep a pattern
Language
English
TOEFL® IBT 81
PTE Academic 62
IELTS 6.5
Prepare for Your English Test
Cathoven AI IELTS Preparation AI-powered IELTS feedback. Clear, actionable, and tailored to boost your writing & speaking score. No credit card or upfront payment required.
- Trusted by 300k learners
- 98 accuracy using real exam data
- 4.9/5 student rating
Delivered
On Campus
Campus Location
- Thuwal, Saudi Arabia
Disciplines
Computer Sciences View 61 other Short Courses in Computer Sciences in Saudi ArabiaExplore more key information
Visit programme websiteWhat students do after studying
Join for free or log in to access our complete career info list.
Academic requirements
GPA 3.5
English requirements
TOEFL® IBT 81
PTE Academic 62
IELTS 6.5
Prepare for Your English Test
Cathoven AI IELTS Preparation AI-powered IELTS feedback. Clear, actionable, and tailored to boost your writing & speaking score. No credit card or upfront payment required.
- Trusted by 300k learners
- 98 accuracy using real exam data
- 4.9/5 student rating
Other requirements
General requirements
- Undergraduate students in 3rd year or above and master’s students.
- Minimum GPA: 3.5/4
- Curriculum Vitae (CV)
- Statement of purpose
- Contact details of 3 referees
- Official English language test score
Student Insurance via Studyportals Partner
Make sure to cover your health, travel, and stay while studying abroad. Even global coverages can miss important items like Additional medical costs, Repatriation, Liability etc. Make sure your student insurance covers your needs.
Studyportals partnered with Aon to provide you with the best affordable student insurance, for a carefree experience away from home.
Get your student insurance nowStarting from €0.53/day, free cancellation any time.
Remember, countries and universities may have specific insurance requirements. To learn more about how student insurance work at King Abdullah University of Science and Technology (KAUST) and/or in Saudi Arabia, please visit Student Insurance Portal.
Make sure you meet all requirements
Visit programme websiteTuition Fees
Tuition fees are shown in and the most likely applicable fee is shown based on your nationality.
-
International Applies to you
Applies to youNon-residentsFree -
Domestic Applies to you
Applies to youCitizens or residentsFree
Additional Details
- This is a fully-funded internship; it includes tuition, airfare, housing, medical insurance, visa reimbursement and a monthly stipend of $1,000.
Living costs
Thuwal
Saudi Arabia
2270 - 3445 SAR / month
The living costs include the total expenses per month, covering accommodation, public transportation, utilities (electricity, internet), books and groceries.
Funding
The KAUST Fellowship includes:
- Full coverage of tuition and bench fees (worth USD $35,000 per year)
- A monthly stipend (worth USD $20,000 per year for PG Diploma and M.S. students, and USD $25,000 to $30,000 for Ph.D. students depending on qualifications and academic progress)
- On-campus housing (worth USD $7,000 per year and covering utilities such as electricity and wifi)
- Health insurance (worth USD $1,450 per year)
- Relocation support (visa, relocation and travel costs)
Improve page content