**Experienced Full Stack Data Engineer – Web & Cloud Application Development at arenaflex**
At arenaflex, we're on a mission to revolutionize the way we collect, process, and analyze data. As a key member of our Dataworks team, you'll play a vital role in designing and driving the development of our data pipelines, working closely with IT, business, developers, and data scientists to deliver high-value insights and solutions.
**About arenaflex**
arenaflex is a leading provider of innovative logistics and transportation solutions. With a strong commitment to technology and innovation, we're constantly pushing the boundaries of what's possible in the industry. Our Dataworks team is at the forefront of this effort, using cutting-edge data engineering techniques to drive business growth and improvement.
**Job Summary**
We're seeking an experienced Full Stack Data Engineer to join our Dataworks team. As a key member of this team, you'll be responsible for designing, developing, and maintaining our data pipelines, working closely with cross-functional teams to deliver high-value insights and solutions. This is an exciting opportunity to work with a talented team of data engineers, developers, and data scientists to drive business growth and improvement.
**Key Responsibilities**
* Design and develop data pipelines to collect, process, and analyze large-scale data sets
* Collaborate with cross-functional teams to deliver high-value insights and solutions
* Work closely with IT, business, developers, and data scientists to ensure data quality and integrity
* Develop and maintain data processing and analytics tools and technologies
* Troubleshoot and resolve complex data-related issues
* Provide technical guidance and support to junior team members
* Stay up-to-date with industry trends and emerging technologies
**Unexpected Expected Set of Responsibilities**
As a Full Stack Data Engineer at arenaflex, you'll be responsible for a wide range of tasks, including:
* Designing and developing data pipelines to collect, process, and analyze large-scale data sets
* Collaborating with cross-functional teams to deliver high-value insights and solutions
* Working closely with IT, business, developers, and data scientists to ensure data quality and integrity
* Developing and maintaining data processing and analytics tools and technologies
* Troubleshooting and resolving complex data-related issues
* Providing technical guidance and support to junior team members
* Staying up-to-date with industry trends and emerging technologies
**Fundamental Work Obligations and Obligations**
* Understanding both the business and technical issues Dataworks aims to address
* Building tools, stages, and pipelines to empower teams to clearly and neatly investigate data, build models, and drive decisions
* Scaling from "PC scale" to "team scale" issues, in terms of both infrastructure and problem design and method
* Collaborating across teams to drive the creation of data-driven functional insights that mean high-value improved solutions
* Delivering clear and actionable value quickly, working closely with different teams of changing backgrounds and disciplines
* Classifying best practices for future reuse as available, reusable examples, layouts, and code bases
* Connecting with senior technologists from the broader project and beyond arenaflex (partner environments and clients) to make collaborative energies and ensure smooth solutions to downstream functional frameworks
**Expertise/Information Thought about an Or more**
* Technical foundation in software engineering, programming, database frameworks, distributed frameworks
* Familiarity with distributed and cloud environments and a deep understanding of enhancing computational considerations with theoretical properties
* Experience in building robust cloud-based data engineering and curation solutions to make data items useful for various applications
* Detailed knowledge of the Microsoft Azure tooling for large-scale data engineering endeavors and solutions is highly preferred. Experience with any combination of the following Azure tools: Azure Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Machine Learning
* Creating and operationalizing functions and solutions including under close to real-time high-volume streaming circumstances
* Active development skills with the ability to work at the code level and help troubleshoot hard-to-resolve issues
* A compelling history of planning and delivering large-scale technical solutions, which convey clear, ongoing value
* Direct experience having built and delivered strong, complex production systems that execute current, data handling strategies at scale
* Ability to set switch, to offer support to distributed teams which might require a "specialist programmer" to unblock a particularly difficult technical obstruction, and to figure out through issues as they are still being defined
* Exhibited ability to deliver technical projects with a team, frequently working under close time constraints to deliver value
* An 'engineering' attitude, able to make fast, practical decisions to improve performance, accelerate progress or amplify influence
* Comfort with working with distributed teams on code-based expectations, using version control frameworks and code reviews
* Ability to lead data analysis, research, and heredity studies to record and upgrade data quality and access
* Utilization of agile and devops practices for project and software management including continuous integration and continuous delivery
**Shown mastery working with some of the following common languages and tools:**
* Flink (Scala and PySpark), Kafka and other high-volume data tools
* SQL and NoSQL storage tools, like MySQL, Postgres, MongoDB/CosmosDB
* Java, Python data tools
* Azure DevOps experience to track work, develop using git-integrated version control examples, and build and use CI/CD pipelines
* Working knowledge and experience executing data engineering patterns to help shifting business needs
* Experience with various data types (json, xml, parquet, avro, unstructured) for both batch and streaming ingestions
* Utilization of Azure Kubernetes Services, Eventhubs, or other related advancements to execute streaming ingestions
* Experience creating and implementing warning and monitoring systems
* Working knowledge of Infrastructure as Code (IaC) through Terraform to create and deploy assets
* Execution experience across various data stores, messaging frameworks, and data processing engines
* Data joining through APIs as well as REST services
* PowerPlatform (PowerBI, PowerApp, PowerAutomate) development experience an or more
**Least Capabilities:**
**Information Architect I:**
* Four-year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work insight
* Essential knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Essential knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
* Experience as a junior member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might counterbalance the connected experience requirements
**Sponsorship isn't available for Information Designer I job.**
**Information Specialist II:**
* Four-year certification in Software engineering, Data Frameworks, a connected quantitative field, for example, Designing or Math or identical proper preparation or work insight
* Two (2) years comparable work insight in estimation and examination, quantitative business critical thinking, reproduction improvement and additionally prescient examination
* Solid knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Solid knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
* Solid comprehension of the transportation business, contenders, and developing advancements
* Experience as a member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might balance the connected experience requirements
**Sponsorship isn't available for Information Architect II job.**
**Information Designer III:**
* Four-year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work insight
* Three to Four (3 - 4) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
* Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Broad knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
* Solid comprehension of the transportation business, contenders, and advancing advancements
* Experience giving authority in a general preparation or counseling setting
* Experience as a senior member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might counterbalance the connected experience requirements
**Information Designer Lead:**
* Four-year college education in Data Frameworks, Software engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work insight
* Five to Seven (5 - 7) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
* Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Broad knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
* Solid comprehension of the transportation business, contenders, and developing advancements
* Experience giving initiative in a general preparation or counseling setting
* Experience as a leader or a senior member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might balance the connected experience requirements
**Residence/Movement Data:**
* This position can be domiciled anywhere in the US.
**Application Standards:**
* Transfer current copy of Resume (Microsoft Word or PDF format only) and answer work screening survey.
**Extra Data**
Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois and New Jersey Residents Only - Compensation: Monthly Pay: $6,317.00 - $15,477.00. This pay range is provided as a reasonable estimate of the current starting compensation range for this job. Factors that may be used to determine your actual compensation may include your qualifications, experience, and performance.
**Top 10 Interview Questions**
* Can you tell us about yourself?
* What interests you about this position?
* What are your strengths?
* What are your weaknesses?
* Can you give an example of a time when you solved a problem creatively?
* How do you handle stress and pressure?
* How would you describe your work style?
* Can you tell us about a time when you had to work with a difficult colleague or supervisor?
* How do you stay organized and prioritize tasks?
* What are your long-term career goals?
**Document Required:**
* Required Documents for This Recruitment: The candidate should have this Document Before Apply Online. Candidates Are Suggested To Read the Official Notification Before Applying.
* Document – Qualifications certificate with mark sheets.
* Passport size Photographs
* Signature
**How to apply:**
* All the eligible candidates can apply for This Job as mentioned below
* Read the official notification carefully From the Official Website.
* Read the Notification Carefully Before Applying.
* Fill out The Application Form (The link Is Given Below)
* Attach the Required Document and Passport Size Photo with Signature.
* Then Submit. Done.
Apply Job!
Apply for this job