AVID Technical Resources is partnering with our client to find a Senior Data Engineer for a full-time opportunity in Des Moines, IA.
The Data Engineer will create and maintain optimal data pipeline architecture. You will be responsible for ongoing design, development, and support of large, complex data sets that meet the functional and non-functional requirements of the business. We're looking for someone with strong knowledge of integration tools, data warehousing, data profiling, and data analysis/visualization tools.
· Work with stakeholders to assist with data-related technical issues and support
· �� Build the infrastructure required for optimal ETL of data from a wide variety of data sources
· Optimize the enterprise data platform to provide optimal performance
· Provide problem-solving expertise and complex analysis of data to develop business intelligence integration designs
· Ensure data quality, and data throughout all the data lake tiers
· 7+ years of relevant experience
· Successful history of manipulating, processing and extracting value from large disconnected datasets
· 5+ years of experience working with Microsoft data integration tools and technologies
· Understanding of batch and streaming data integration methodologies
· Strong Knowledge of API Management technologies, microservice architecture and distributed pub-sub messaging platform
· Familiarity with Python of C#
· Ability to design scalable system architectures on Azure and across private/hybrid infrastructures via bare metal, virtualized and container-based deployments
· Experience with data modeling and building data stores that leverage structured and unstructured databases
· Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
· Experience supporting and working with cross-functional teams in an agile environment
· Ability to create or interpret detailed project specifications to develop program logic and code
· Ability to work in a full-time role without the aid of sponsorship
About AVID Technical Resources:
AVID (Applications, Voice, Internet, Data) Technical Resources is a contract and permanent IT recruiting company. Headquartered in Boston, AVID specializes in placing information technology professionals with either an Infrastructure Support or Applications Development background.
Since our inception in 2003, AVID has grown to be among the leading IT recruiting firms in the area. This explosive growth has led to a number of awards and recognition. Inc. Magazine recently listed AVID on their exclusive Inc. 500/5000 Fastest Growing Privately-Held Companies in the US. AVID was named one of the Leading IT Staffing Agencies in the Northeast by Forbes Magazine and the Boston Business Journal ranked AVID Technical Resources the 7th Fastest Growing Privately-held Company in Massachusetts.
Contact one of our IT recruiters today: www.avidtr.com.