Seamless User Experience & Leaderboard Porting

[gchhablani]

Project Title: Seamless User Experience & Leaderboard Porting

Description: This project aims to enhance the overall user experience on EvalAI by introducing user-centric features, improving existing functionalities, and optimizing integrations with external platforms.

Two key features that we aim to implement in this project will be:

• Allowing custom requests on code-upload and static code-upload challenges from within the evaluation workers running on EKS platform.
• Making enhancements to the EvalAI in an efficient way to to migrate existing leaderboards for external challenges from various sources (maybe a tabular format) to EvalAI as the hosts migrate their challenges to EvalAI.

These features, coupled with additional deliverables below, will improve the overall experience of EvalAI users and add several utilities for improving challenge participation experience.

Deliverable:

• Code-Upload Challenges Improvements:
  • Allow custom requests for EKS challenges to external sites like HuggingFace and OpenAI for model downloads.
  • Address sporadic pod log population on AWS and address the existing issue of environment logs not getting populated on our backend from CloudWatch.
• Leaderboard Migration:
  • Provide a solution for transferring existing challenge leaderboards from external sources to EvalAI.
  • This involves adding an ability to take a CSV (or any other format) of participant teams, leaderboard metrics, submission timestamp, challenge name and convert it to an “archived” entry on the public leaderboard to see.
• User-centric Features:
  • Implement a customizable participant details download option on the analytics dashboard.
  • Improve error handling and display for email verification issues.
  • Embed the forum on the challenge page for easy communication between hosts and participants.
• Additional User Experience Improvements:
  • Fix the search and filter feature PR and perform robust testing on the same.
  • Automate challenge category/forum creation on EvalAI forum during challenge approval.

Mentor: Rahul Singh, @gautamjajoo , @gchhablani @RishabhJain2018

Skills: SQL, Django, AngularJS, AWS

Skill Level: Medium

Get started: Try to fix some issues in EvalAI (note that there are some issues labeled with GSoC-2024).

Important Links:

• EvalAI Website: eval.ai
• EvalAI Github repository: Cloud-CV/EvalAI
• EvalAI Docs: http://evalai.readthedocs.io/en/latest
• GSoC Proposal Template: Cloud-CV/GSoC-Ideas/wiki/GSOC-2020-Proposal-Template
• Gitter Channel: gitter.im/Cloud-CV
• Mailing list: groups.google.com/forum/#!forum/cloudcv

[Antoniocolapso]

Interested for the project.

A little bit about me :

I'm Omm Prakash Sahoo from IIT Bhilai, 3rd year b.tech. i recently become ML guy after doing CP and dev in my first 2 years.Was ICPC regionalist expert at CodeForces done decent amount of DEVoPs, Developed both Web and android apps, topped in SystemDesign and ML course at our college, built LIP-Reader (predicting sentence only by lip movement), was lead of INTER-IIT Tech meet team for Adobe behaviour simulation challenge in which we developed 2 LLMs to ease the process of posting new content for marketing for companies in every segment and a lots of interesting works.

After achieving my personal goals in CP in first 2 years now i want to finally contribute to real-world problems.Coz have been member of GDSC, OpenLake(Club for Open Source enthusiasts at IIT Bhilai) and Co-ordinator of Ingenuity (CP club).

Here is my resume link : https://drive.google.com/file/d/1LbGBW9veH75x7IqABSk9ui03JIzZv7cV/view?usp=drive_link

I will be there to solve it soon.

[ritikraj26]

Hello,

My name is Ritik Raj and I'm a fourth-year undergraduate student at the Indian Institute of Technology Kharagpur pursuing an integrated dual degree course with minors in Computer Science Engineering and micro-specialization in Artificial Intelligence and Applications. I'm writing to let you know that I'm interested in contributing to your organization's project as part of Google Summer of Code 2024.

This project completely aligns with my skills and interests and I am very excited to contribute to this project through this program.

My technical skills include:

Programming Languages: Python, JavaScript, C++
Frameworks/Tools: Django, Flask, React, Angular, PostgreSQL
Other Relevant Skills: Git, Postman, Jupyter, DBeaver

I'm confident I can become a valuable contributor to your project. I'm eager to learn and collaborate through this project. I'm available to discuss a potential project proposal in more detail. Please find my resume attached along with the cover letter.
Resume

Thank you for considering my application. I look forward to hearing from you.
Sincerely,
Ritik Raj
IIT Kharagpur
Email: ritikraj2699@gmail.com
LinkedIn GitHub

[KrishGaur1354]

A little about me:

Hey @gchhablani, @gautamjajoo & @RishabhJain2018,

My name is Krish Gaur, and I am based in New Delhi, India. I am a passionate and driven individual with a strong background in full-stack development and a keen interest in artificial intelligence and machine learning applications. I am excited about contributing to the project outlined by your organization for Google Summer of Code 2024.

Professional Skills:

• Programming Languages: I am proficient in Java, C, Golang, Python, HTML, CSS, and JavaScript, which are essential for both front-end and back-end development.
• Developer Tools: I have experience with various developer tools like Git, Docker, Kubernetes, Rest API, Flask, and React.js, enabling me to efficiently build and deploy applications.
• Databases: My skills include working with databases such as MongoDB, MySQL, and PostgreSQL, allowing me to design and manage data effectively.
• AIML Tools: I am familiar with AIML tools like Pandas, NumPy, Matplotlib, Scikit-Learn, TensorFlow, and OpenCV, enabling me to develop machine learning applications.

Achievements:

• AWS AI/ML Scholar: Recognized for securing a position in the top 10 competitors in the AWS DeepRacer Student League.
• Active Open-Source Contributor: Actively participate in programs like Hacktoberfest, SWoC, and KWoC, contributing to initiatives like C4GT 2023 for the Indian Government.
• Hackathon Success: Participated in numerous hackathons and coding competitions, winning accolades in events like GDSC SolveSphere.

I am eager to leverage my skills and experiences to contribute effectively to your project. Looking forward to discussing further details.

Best Regards,
Krish Gaur (Resume)
Email: krishgaur13@gmail.com

[ABHI080201]

Hey @gchhablani, @gautamjajoo & @RishabhJain2018,

Hello everyone, I hope you're doing well! My name is Abhishek, and I'm thrilled to begin my GSoC journey. As a beginner in both GSoC and open source contributions, I'm excited to learn and contribute to the EvalAI project. My primary interests lie in Full Stack AI Development and Data Science. I would greatly appreciate any guidance or advice to help me get started on the right path.