Enqurious Facilitated Cross-Skilled Hackathon for 100+ Engineers to Boost Team Efficiency at a Growing Enterprise AI Services Firm

A $700M Enterprise AI Company sought to build a talent pool of industry-ready Databricks and Snowflake Data Engineers. The challenge was to develop a learning experience that went beyond certification exams, providing candidates with practical, real-world project experience. Enqurious partnered with the client to create a hands-on, scenario-driven learning path that increased certification clearance rates and equipped learners with real-world skills.

Problem Statement

The AI company had two primary objectives:

1. Certification Clearance Rate: The goal was to have learners achieve a high clearance rate for both Databricks and Snowflake certifications.
   

2. Real-World Project Exposure: The aim was to equip candidates with practical, industry-relevant skills, moving beyond just passing exams to becoming job-ready engineers. This practical experience was key to the client’s vision of developing capable data engineers who could seamlessly integrate into real-world business projects.

The challenge was to design an immersive, hands-on learning experience that not only prepared learners for certification but also provided them with the skills required for real-world data engineering tasks.

How We Helped

Enqurious designed a 4-week, scenario-driven, lab-integrated skill path tailored specifically to the client’s needs. The learning path included:

• Masterclasses: Focused on foundational concepts in Databricks and Snowflake, building strong industry-specific knowledge for learners.

• Lab-Integrated Scenarios: Seamlessly integrated sandboxes with industry-inspired scenarios. These scenarios covered the full scope of real-world data engineering tasks, including architecture design, data ingestion, and complex workflows in the E-commerce domain. The scenarios were crafted to replicate challenges learners would face in actual job roles, ensuring they gained hands-on experience.

• Mock Tests: Full-length mock tests designed to closely mirror the actual certification exams. These were structured to familiarize learners with the exam format and provide a realistic testing environment to assess their readiness.

Metrics & Value Proposition

• Early Warning System: A proactive approach to learner engagement, identifying candidates who might need additional support. This early intervention system ensures timely actions are taken to boost learner success.

• Skill Intelligence: In-depth insights into learners' skill development, enabling focused improvement in areas that need the most attention. By honing in on these targeted areas, learners can optimize their study time, avoid unnecessary broad mock tests, and enhance their efficiency.

• Learning Progress Tracking: Continuous monitoring of learner progression to ensure they remain on track. This feature helped both learners and instructors keep a clear overview of development.

• Automated Recommendation List: A system that provides personalized recommendations based on the learner's progress. This feature acts as a guide for learners, offering suggestions on when they are ready to sit for the certification exams, helping them maximize their time and efforts effectively.

The Impact Experienced

• Certification Success:
  

  • 97% clearance rate for Databricks Associate Data Engineer Certification, with 400 learners successfully passing.

  • 92% clearance rate for SnowPro Core Certification, with 350 learners successfully passing.

• Increased Business Value:

  • 20% increase in differential billing due to the enhanced capabilities of the certified learners.

A billion-dollar Enterprise AI Company, faced significant productivity challenges in their data engineering projects due to the lack of effective debugging skills among their Junior Data Engineers. This issue resulted in long periods of time spent on bug identification, resolution, and testing, impacting the overall efficiency of their teams.

Problem Statement

• Challenges:
  

  • Time-Intensive Debugging: Nearly 75% of active work time was consumed by debugging processes.

  • Inadequate Knowledge: Junior Data Engineers were unfamiliar with common issues in key areas such as data ingestion, quality treatment, storage, ETL, and data modeling.

  • Impact on Productivity: Due to the lack of awareness of frequently occurring issues, engineers spent excessive time figuring out problems rather than focusing on system design, implementation, and problem-solving.

• Goals:
  

  • Reduce Debugging Time: Shift focus from bug resolution to more productive activities like system design and problem-solving.

  • Increase Debugging Awareness: Equip engineers with the knowledge of the 20% of issues that cause 80% of the bugs in SQL data wrangling workflows.

How We Helped

Enqurious designed a Bug Bounty program aimed at improving the debugging skills of Junior Data Engineers by simulating real-world issues they commonly face.

• Program Design:
  

  • The program consisted of 10 scenarios, each with buggy code covering various intermediate to advanced SQL topics including CTEs, Window functions, Data Modeling, and Performance Tuning.

  • Error Types: The scenarios ranged from simple syntax errors to complex logical flaws and poor code design.

  • Engagement: To foster competition and engagement, a leaderboard was introduced to highlight the engineers who identified and fixed the most bugs.

• Additional Features:

  • Leaderboard to track and reward top engineers based on points earned.

  • Progress Tracking to monitor individual learning journeys.

  • Skills Assessment to identify engineers with great debugging skills and those who needed further development.

  • Data-Driven Insights on acquired skills and areas requiring attention.

Metrics & Value Proposition

• Participation: 200+ Junior Data Engineers participated in the Bug Bounty.

• Completion Rate: Over 90% of the engineers successfully completed the program.

• Skill Improvement:

  • 70% of participants reported a significant improvement in their debugging skills.

  • Faster identification and resolution of bugs, leading to better testing and documentation of workflows.

• Value Delivered:

  • Time Reduction: A noticeable reduction in time spent on debugging, allowing engineers to dedicate more time to system design, implementation, and problem-solving.

  • Increased Confidence: Engineers gained confidence in troubleshooting common issues, improving their efficiency in real-world projects.

  • Skill Tracking: Data-driven insights enabled the identification of engineers’ strengths and weaknesses, allowing for tailored skill development plans.

The Impact Experienced

The Bug Bounty program yielded significant improvements in both technical skills and overall productivity:

• Enhanced Debugging Skills: Engineers became more proficient in identifying common bugs and resolving issues quickly, improving workflow efficiency.

• Faster Time to Resolution: With improved debugging knowledge, engineers reduced the time spent on bug identification and resolution, contributing to increased project delivery speed.

• Better Documentation and Testing: Engineers also developed a stronger focus on documenting bugs and testing solutions more thoroughly, ensuring higher-quality data workflows.

A rapidly growing Enterprise AI services firm, faced significant challenges as their teams expanded in size. With engineers and professionals from varied skill backgrounds such as Data Analysts, Data Engineers, Data Scientists, and Software Engineers, coordinating workflows and achieving seamless collaboration became increasingly difficult. As a result, productivity issues surfaced, impacting project timelines and outcomes.

Problem Statement

The key issue at hand was the difficulty in achieving smooth collaboration between team members with different technical skill sets. Specifically:

• Frictions in workflows: Data Analysts, Data Engineers, Data Scientists, and Software Engineers often worked in silos, leading to miscommunication, delays, and inefficiencies in project delivery.

• Lack of cross-functional understanding: Teams struggled to appreciate each other’s strengths and challenges, which affected their ability to work cohesively toward project goals.

The learning experience needed to address these issues by fostering better teamwork, communication, and understanding among individuals from different disciplines while working on real-world projects.

How We Helped

Team Enqurious designed and executed an end-to-end Enterprise Analytics Project Simulation tailored to mimic real-world conditions where different skill personas collaborate. The project was structured as a Cross-Skilled Hackathon involving 30 teams, each consisting of:

• 1 Data Analyst

• 1 Data Engineer

• 1 Data Scientist

• 1 Software Engineer

The goal was for these teams to work together to build a functioning data app and deliver a live demonstration to a panel of senior Subject Matter Experts (SMEs). The project also required the following key components:

• Team Coordination: Teams were encouraged to establish clear processes for collaboration and problem-solving.

• Knowledge Sharing: Each persona had to contribute their specialized knowledge to the project, ensuring a holistic solution.

• Final Deliverables: Teams were scored based on their presentation skills, depth of knowledge, process establishment, and the final outcome of the app they built.

Metrics & Value Proposition

The following added value propositions were integrated to ensure the hackathon was both educational and engaging:

• Leaderboard: Track the top-performing teams based on points earned for project execution and presentation.
  
  

• Learning Progress Tracking: Real-time monitoring of each team’s learning journey and progress.

• Top Teams Recognition: Highlight the teams with the best presentations and most impactful demonstrations.

• At-Risk Teams: Identifying and flagging teams showing low or no progress to allow for early intervention.

• Post-Evaluation Insights: Provide a detailed analysis of teams based on key skills such as presentation, technical knowledge, and problem-solving abilities.

• Artefacts and Rewards: Teams received tangible rewards such as gift coupons for their efforts, along with artefacts like video clips of their presentations, code snippets, and snapshots of their best work.

The Impact Experienced

• Improved Team Coordination: Over 100 engineers from diverse backgrounds collaborated under a tight schedule, fostering deeper understanding and trust across disciplines. The experience helped bridge the gap between the various technical personas, resulting in smoother workflows.

• Enhanced Skill Application: Participants gained a better appreciation of how each skill set contributed to the success of the project, improving cross-functional understanding.

• Project Success: Teams successfully built working apps, delivered live demonstrations, and received real-time feedback from senior experts, ensuring the project met the desired outcomes.

• Long-Term Collaboration: The hackathon format encouraged teams to strengthen their relationships, fostering a spirit of collaboration that continues to benefit the organization.

A rapidly growing Enterprise AI services firm, was facing challenges with their graduate engineer onboarding process. The onboarding program, which lasted for 6 months, included a technical training module that spanned a wide range of disciplines. However, the firm identified significant inefficiencies, especially in the early stages of the training program. The major challenge stemmed from the varying proficiency levels of graduate engineers in foundational skills, leading to extended training times and delays in deploying engineers for critical project work.

Problem Statement

The core issue revolved around the differing levels of proficiency in foundational technical skills among the graduate engineers when they joined the firm. Specifically:

• Varying skill levels: Graduate engineers, especially those with Computer Science backgrounds, were more comfortable with the foundational skills, while others were new to them entirely. This disparity meant that a large portion of the onboarding program was dedicated to bridging these gaps.

• Extended training duration: Due to this skill gap, the onboarding program had to allocate an additional 6-8 weeks to foundational skill development. This led to delays in getting the engineers ready for more business-specific training, which further extended the timeline before they could contribute to projects.

The client wanted to achieve two key goals:

• Homogeneity in foundational skills at the time of joining.

• Reduction in onboarding duration to allow engineers to focus sooner on in-depth, business-specific training.

How We Helped

Team Enqurious designed a comprehensive 8-week pre-boarding program tailored for engineers in their final semester at college. The program aimed to address foundational skill gaps before the engineers even joined the firm. The solution included:

• Foundational Skills Mastery: The program focused on critical areas like Business Analysis, Data Analysis, Data Engineering, Programming, Cloud technologies, and Data Science. By ensuring all engineers were aligned on these skills, the program created a common baseline of proficiency.

• Accelerated Onboarding: With the foundational skills already cemented, the client was able to reduce the onboarding training duration by 8 weeks, thus making the process more efficient.

• Seamless Transition: The pre-boarding program ensured a smooth and frictionless start for engineers, allowing them to quickly dive into more advanced, business-specific skilling upon joining the firm.

Metrics & Value Proposition

The following additional value propositions were integrated into the pre-boarding program to maximize its impact:

• Leaderboard: A leaderboard tracked the top-performing engineers based on their learning progress and assessments.

• Learning Progress Tracking: Real-time tracking of engineers' progress was made available to Learning & Development (L&D) teams to monitor performance and make adjustments if necessary.

• Appreciation via Badges: Top performers were rewarded with badges, incentivizing continued engagement and excellence.

• Timely Nudges: Lagging performers were given timely nudges to help them stay on track.

• Prepare-Practice-Perform Model: The learning experience followed this model, including practice scenarios, mini-capstone projects, and timed assessments to enhance practical learning.

• Human-in-the-loop Evaluation: Each engineer’s work was evaluated by experts who provided personalized feedback, further enhancing learning outcomes.

• In-Depth Skill Insights: The L&D teams and delivery stakeholders were provided with detailed insights into the skill levels of engineers, helping identify top talent and those needing additional support.

The Impact Experienced

• Reduced Onboarding Time: Over 1000 graduate engineers were effectively groomed with the necessary foundational skills prior to joining, reducing the overall onboarding timeline by 50%. This accelerated their preparedness for the critical project work they would be involved in.

• Faster Talent Deployment: With engineers already equipped with the essential skills, they could quickly transition to more specialized business training, allowing for faster turnaround times for talent preparedness for critical project deployments.

• Improved Readiness for In-Depth Training: Engineers entered the main onboarding process with a high level of preparedness, making them more responsive to business-specific training and enabling a faster integration into the company’s core projects.