At arenaflex, we're on a mission to revolutionize the way data is collected, processed, and analyzed. As a key member of our Dataworks team, you'll play a vital role in designing and developing cutting-edge data pipelines that drive business insights and inform strategic decisions. If you're passionate about data engineering, cloud computing, and collaboration, we want to hear from you!
**About arenaflex**
arenaflex is a leading provider of innovative logistics and transportation solutions. Our team of experts is dedicated to delivering exceptional customer experiences through data-driven insights and strategic partnerships. With a strong focus on technology and innovation, we're constantly pushing the boundaries of what's possible in the industry.
**Job Summary**
We're seeking an experienced Full Stack Data Engineer to join our Dataworks team. As a key member of this team, you'll be responsible for designing, developing, and deploying data pipelines that drive business insights and inform strategic decisions. You'll work closely with cross-functional teams to ensure seamless integration and collaboration.
**Key Responsibilities**
* Design and develop data pipelines that collect, process, and analyze large datasets
* Collaborate with data scientists, engineers, and analysts to identify business needs and develop data-driven solutions
* Develop and maintain data infrastructure, including data warehouses, data lakes, and data pipelines
* Ensure data quality, integrity, and security through robust data governance and compliance practices
* Work with cloud-based technologies, including Azure, AWS, and Google Cloud Platform
* Develop and maintain data visualizations and reporting tools to support business decision-making
* Collaborate with stakeholders to identify business needs and develop data-driven solutions
* Stay up-to-date with industry trends and emerging technologies to ensure arenaflex remains at the forefront of innovation
**Unexpected Expected Set of Responsibilities**
As a Full Stack Data Engineer at arenaflex, you'll assume a vital part in Dataworks, focused on making and driving designing development and working with the conveyance of key business drives. You'll go about as a "all inclusive interpreter" between IT, business, computer programmers, and information researchers, teaming up across multi-disciplinary groups to convey esteem. You'll chip away at those parts of the Dataworks stage that oversee the ingestion, change, and pipelining of information resources, both to end clients inside arenaflex and into information items and administrations that might remotely confront.
**Fundamental Work Obligations and Obligations**
* Understanding inside and out both the business and specialized issues Dataworks intends to address
* Building apparatuses, stages, and pipelines to empower groups to obviously and neatly investigate information, assemble models, and drive choices
* Increasing from "PC scale" to "group scale" issues, as far as both foundation and issue design and method
* Teaming up across groups to drive the age of information driven functional bits of knowledge that mean high worth improved arrangements
* Conveying unmistakable worth quickly, working together with different groups of changing foundations and disciplines
* Classifying best practices for future reuse as available, reusable examples, layouts, and code bases
* Connecting with senior technologists from the more extensive venture and beyond arenaflex (accomplice environments and clients) to make cooperative energies and guarantee smooth arrangements to downstream functional frameworks
**Expertise/Information Thought about an Or more**
* Specialized foundation in software engineering, programming, data set frameworks, circulated frameworks
* Familiarity with circulated and cloud conditions and a profound comprehension of enhancing computational contemplations with hypothetical properties
* Experience in building hearty cloud-based information designing and curation answers for make information items helpful for various applications
* Point by point information on the Microsoft Purplish blue tooling for enormous scope information designing endeavors and arrangements is exceptionally liked. Experience with any blend of the accompanying sky blue instruments: Purplish blue Databricks, Purplish blue Information Processing plant, Sky blue SQL D, Sky blue Neurotransmitter Investigation
* Creating and operationalizing capacities and arrangements including under close to ongoing high-volume streaming circumstances
* Active advancement abilities with the capacity to work at the code level and help troubleshoot hard to determine issues
* A convincing history of planning and conveying huge scope specialized arrangements, which convey unmistakable, progressing esteem
* Direct experience having constructed and conveyed strong, complex creation frameworks that carry out current, information handling strategies at scale
* Capacity to setting switch, to offer help to scattered groups which might require an "specialist programmer" to unblock a particularly difficult specialized obstruction, and to figure out through issues as they are as yet being characterized
* Exhibited capacity to convey specialized projects with a group, frequently working under close time requirements to convey esteem
* An 'designing' attitude, able to make fast, commonsense choices to further develop execution, speed up progress or amplify influence
* Solace with working with circulated groups on code-based expectations, utilizing rendition control frameworks and code surveys
* Capacity to lead information examination, examination, and heredity studies to record and upgrade information quality and access
* Utilization of coordinated and devops rehearses for venture and programming the board including ceaseless combination and constant conveyance
**Shown mastery working with a portion of the accompanying normal dialects and instruments:**
* Flash (Scala and PySpark), Kafka and other high-volume information apparatuses
* SQL and NoSQL stockpiling apparatuses, like MySQL, Postgres, MongoDB/CosmosDB
* Java, Python information apparatuses
* Purplish blue DevOps experience to follow work, foster utilizing git-incorporated rendition control examples, and fabricate and use CI/Album pipelines
* Working information and experience executing information engineering examples to help shifting business needs
* Experience with various information types (json, xml, parquet, avro, unstructured) for both bunch and streaming ingestions
* Utilization of Purplish blue Kubernetes Administrations, Eventhubs, or other related advancements to carry out streaming ingestions
* Experience creating and carrying out cautioning and observing systems
* Working information on Framework as Code (IaC) through Terraform to make and convey assets
* Execution experience across various information stores, informing frameworks, and information handling motors
* Information joining through APIs as well as REST administration
* PowerPlatform (PowerBI, PowerApp, PowerAutomate) improvement experience an or more
**Least Capabilities:**
* Information Architect I:
+ Four year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work insight
+ Essential information in information designing and AI structures including plan, advancement and execution of profoundly complex frameworks and information pipelines
+ Essential information in Data Frameworks including plan, advancement and execution of huge cluster or online exchange based frameworks
+ Experience as a lesser individual from multi-utilitarian undertaking groups
+ Solid oral and composed relational abilities
* Information Specialist II:
+ Four year certification in Software engineering, Data Frameworks, a connected quantitative field, for example, Designing or Math or identical proper preparation or work insight
+ Two (2) years comparable work insight in estimation and examination, quantitative business critical thinking, reproduction improvement and additionally prescient examination
+ Solid information in information designing and AI structures including plan, advancement and execution of profoundly complex frameworks and information pipelines
+ Solid information in Data Frameworks including plan, advancement and execution of huge group or online exchange based frameworks
+ Solid comprehension of the transportation business, contenders, and developing advancements
+ Experience as an individual from multi-utilitarian undertaking groups
+ Solid oral and composed relational abilities
* Information Designer III:
+ Four year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work insight
+ Three to Four (3 - 4) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
+ Broad information in information designing and AI structures including plan, advancement and execution of exceptionally complex frameworks and information pipelines
+ Broad information in Data Frameworks including plan, advancement and execution of enormous cluster or online exchange based frameworks
+ Solid comprehension of the transportation business, contenders, and advancing advancements
+ Experience giving authority in a general preparation or counseling setting
+ Experience as a senior individual from multi-utilitarian undertaking groups
+ Solid oral and composed relational abilities
* Information Designer Lead:
+ Four year college education in Data Frameworks, Software engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work insight
+ Five to Seven (5 - 7) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
+ Broad information in information designing and AI structures including plan, advancement and execution of exceptionally complex frameworks and information pipelines
+ Broad information in Data Frameworks including plan, advancement and execution of enormous bunch or online exchange based frameworks
+ Solid comprehension of the transportation business, contenders, and developing advancements
+ Experience giving initiative in a general preparation or counseling setting
+ Experience as a pioneer or a senior individual from multi-capability project groups
+ Solid oral and composed relational abilities
**Residence/Movement Data:**
* This position can be domiciled anyplace in the US.
**Application Standards:**
* Transfer current duplicate of Resume (Microsoft Word or PDF design just) and answer work screening survey.
**Extra Data**
* Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois, and New Jersey Occupants Just - Remuneration: Month to month Pay: $6,317.00 - $15,477.00. This pay range is given as a sensible gauge of the ongoing beginning compensation range for this job. Factors that might be utilized to decide your genuine compensation may include your experience, abilities, and the necessities of the job.
**How to Apply:**
* All the eligible candidates can apply for this job as mentioned below
* Read the official notification carefully from the official website
* Read the Notification Carefully Before Applying
* Fill out the Application Form (The link is given below)
* Attach the Required Document and Passport Size Photo with Signature
* Then Submit. Done.
Apply Job!
Apply for this job