Nvidia is hiring a
Senior Software Engineer, Data Ingestion - Autonomous Vehicles
As an AV Data Ingestion and Serving engineer, you will play a crucial role in managing and optimizing the flow of data from various sources into our AV systems. Your primary focus will be on ensuring the seamless ingestion and efficient serving of AV data to support critical operations.
What you'll be doing:
Implement and maintain data ingestion pipelines from diverse sources, ensuring a continuous and reliable flow of AV data into the system.
Design and optimize data serving mechanisms to deliver AV data to different teams and applications in real-time and batch processing scenarios.
Monitor data pipelines and services to proactively identify and resolve any issues, ensuring data availability and reliability.
Collaborate with cross-functional teams to improve data processing efficiency, reduce latency, and enhance overall system performance.
Implement validation and data quality checks to ensure the integrity and accuracy of ingested data.
Scale data infrastructure to handle the ever-increasing volumes of AV data generated by our expanding fleet of vehicles.
Create and maintain detailed documentation for data ingestion and serving processes, ensuring knowledge sharing across the team.
Work closely with the AV development team to understand data requirements and contribute to the enhancement of data-driven solutions.
What we need to see:
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
8+ years of work experience.
Extensive expertise in developing distributed systems.
Proven experience in designing and building data ingestion pipelines for large-scale systems.
Strong proficiency in data warehousing concepts, data modeling, and database management systems.
Proficient in Go, C++ and have experience with scripting languages such as Python or Matlab in a Linux environment
Familiarity with distributed computing frameworks like Apache Spark or Hadoop.
Hands-on experience with data streaming technologies (e.g., Kafka, RabbitMQ) is a plus.
Knowledge of cloud-based platforms (AWS, GCP, or Azure) and containerization (Docker/Kubernetes).
Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
You will also be eligible for equity and benefits.
Please mention that you found the job on ARVR OK. Thanks.