Data Systems Engineer
<p><strong>Please find the Job Position Details;</strong></p><p><strong>Position: Data Systems Engineer </strong></p><p><strong>Location: Alpharetta, GA OR Menlo Park, CA (3 Days Onsite - Hybrid)</strong></p><p><strong>Duration: 12+ Months (with possible extension)</strong></p><p><br></p><p><strong>Years of experience: </strong>7-15 years Exp </p><p> </p><p><strong><u>Must:</u></strong></p><p>Need to have strong working knowledge on Linux platform</p><ul><li>Application Development Exp - Python (#1) - Ruby or Shell (#2)</li><li>Need to be able to run the application within <u>Linux</u> - debug - understand when they run the application there is a memory CPU, etc.</li></ul><p>ELK (Elastic Search) Exp</p><p>Kafka building pipeline with ELK and Kafka</p><p>Strong communication, Team Player and someone who is open to learning and getting their hands dirty.</p><p>Ability to learn - Curiosity </p><p><br></p><p><strong><u>Plus</u></strong>:</p><ul><li>Fling</li><li>Snowflake Database Exp</li><li>Spark Data processing</li><li>Good Data Analysis Background</li><li>ELK Certification</li><li>Observability and Data Analysis</li></ul><p> </p><p><strong><u>Day to Day:</u></strong></p><ul><li>This person will not only be doing the pipeline development, but will work in large sacle cluster setting.</li><li>Will requires the understanding of scalability in the kafka environment</li><li>This person will ensure the jobs are up and running, debug it and support the 100s of customers who use their system</li><li>Be the person to support those people</li></ul><p>Pipeline development using Kafka, ELK and Hycon</p><p>Will need a strong knowledge of linux because that’s where they deploy their jobs in the 100s</p><p>Pipeline is within kafka and almost all the data is writing within ELK (need to understand how the data is stored)</p><p>This is a diverse background! </p><p><br></p><p><strong>Job Description:</strong></p><ul><li>RTOI Data Engineer</li><li>Realtime operation intelligence team in client Enterprise Computing is responsible to stream terabytes of data daily.</li><li>Client has built job frameworks to run large scale ETL pipelines with Kafka, ElasticSearch ELK, Snowflake, Hadoop.</li><li>Client applications run both on perm and on the cloud.</li><li>There are hundreds of dashboards built for business and operations to provide insight and actionable items at real time.</li></ul><p><br></p><p><strong>Client is looking for streaming, data engineer:</strong></p><ul><li>Understand distributed systems architecture, design and tradeoff.</li><li>Design and develop ETL pipelines with a wide range of technologies.</li><li>Able to work on full cycle of development including defining requirement, design, implementation, testing, deployment.</li><li>Strong communication skills to collaborate with various teams.</li><li>Able to learn new technologies and work independently.</li></ul><p><br></p><p><strong>Requirements:</strong></p><ul><li>5 years of application development experience, at least 2 years data engineering with Kafka.</li><li>Working experience writing and running applications on Linux.</li><li>5 years of coding experience with at least one of the languages: Python, Ruby, Java, C/C++, GO.</li><li>SQL and database experience.</li></ul><p><br></p><p><strong>Optional:</strong></p><ul><li>AWS or other cloud technologies.</li><li>ElasticSearch ELK</li></ul><p></p>