Data Engineer II

<div class="content-intro"><p>HackerRank helps companies like NVIDIA, Amazon, and Microsoft hire and upskill the next generation of developers based on skills, not pedigree. Our platform is trusted by over 2,500 of the world’s most innovative companies to build strong engineering teams ready for what’s next.<br><br>Software has entered an era where humans and AI build side by side. As this shift accelerates, the definition of strong technical talent is changing. We give companies better ways to identify and invest in next-generation skills.<br><br>People at HackerRank care deeply about the impact of their work and sweat the small details so our customers can be wildly successful with products they genuinely love to use. We move with urgency and believe great outcomes come from high standards.</p></div><p><strong>About the role</strong></p> <p>HackerRank's data platform has just come through a major modernisation - moving from Redshift to StarRocks + Apache Hudi, and cutting export latencies from 25 seconds to under 5. The foundation is in place, and we're now building toward an AI-native data layer that will power features like natural language querying for HackerRank for Work customers.</p> <p>As a Data Engineer II, you'll work within the data team to build and maintain pipelines, support in-product data features, and contribute to the datasets that power our AI initiatives. You'll work closely with senior engineers and the Lead Data Engineer, picking up well-scoped problems and growing into broader ownership over time.</p> <p><strong>What you will do</strong></p> <ul> <li>Build and maintain data pipelines on our stack - StarRocks (OLAP), Apache Hudi (Data Lake), Trino, and Spark - under guidance from senior team members.</li> <li>Support in-product data features such as exports, insights dashboards, interview analytics, and the Custom Reports interface.</li> <li>Help prepare clean, structured datasets that feed into AI-powered features like natural language querying.</li> <li>Implement access controls and data security policies (e.g., Apache Ranger) as defined by senior engineers.</li> <li>Respond to and help reduce ad-hoc data requests from internal teams (AI platform, analytics, go-to-market) by contributing to self-service pipelines.</li> <li>Write clear documentation and participate in code/design reviews.</li> <li>Troubleshoot data quality and pipeline issues, escalating architectural decisions to senior engineers.</li> </ul> <p><strong>Who you are</strong></p> <ul> <li>2-4 years of data engineering experience.</li> <li>Working knowledge of at least one OLAP database (StarRocks, ClickHouse, Druid, or similar).</li> <li>Some experience with data lake technologies (Hudi, Iceberg, or Delta Lake) - deep expertise not required, willingness to learn is.</li> <li>Familiarity with distributed query engines (Trino/Presto) and Spark, or strong SQL/Python fundamentals with eagerness to pick these up.</li> <li>Basic understanding of data security and access control concepts.</li> <li>Comfortable in an AWS + open-source environment, or quick to ramp up.</li> <li>Good communicator who can explain their work to teammates and ask for help when scoping is unclear.</li> </ul> <p><strong>Even better if you have</strong></p> <ul> <li>Any exposure to AI/LLM-adjacent data work - even coursework or side projects with RAG, vector stores, or LLM pipelines.</li> <li>Interest in how data products get consumed by non-technical, end-customer-facing features.</li> <li>Experience at a SaaS or B2B product company.</li> </ul> <p><strong>You will thrive in this role if</strong></p> <ul> <li>You want to grow your skills on a modern, production-grade data stack.</li> <li>You like clearly-scoped problems but are eager to take on more ambiguity over time.</li> <li>You care about doing good, reliable engineering work more than being the one setting direction.</li> <li>You're curious about AI and want to build the pipelines that feed it, even if you're not designing the AI systems yourself.</li> <li>You like working closely with a senior mentor and leveling up quickly.</li> </ul><div class="content-conclusion"><p><strong>Want to learn more about HackerRank?</strong> Check out <a href="http://hackerrank.com/">HackerRank.com</a> to explore our products, solutions and resources, and dive into our story and mission <a href="https://www.hackerrank.com/about-us/">here</a>.</p> <p>HackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment based on individual performance and qualification. We never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines. </p> <p><a href="https://www.linkedin.com/company/hackerrank/">Linkedin</a> | <a href="https://twitter.com/hackerrank">X</a> |<a href="https://www.linkedin.com/company/hackerrank/"> </a><a href="https://blog.hackerrank.com/?utm_medium=email&utm_content=signature">Blog</a> | <a href="https://www.instagram.com/hackerrank?igsh=MWNid2d6aWlxYnl0OQ==">Instagram</a> | <a href="https://www.instagram.com/lifeathackerrank?igsh=eDFta3owaTJsbW5x">Life@HackerRank</a></p> <p><em>Notice to prospective HackerRank job applicants:</em></p> <ul> <li><em>Our Recruiters use @hackerrank.com email addresses.</em></li> <li><em>We never ask for payment or credit check information to apply, interview, or work here.</em></li> </ul></div>