Date Posted: 10/04/2024
Hiring Organization: Rose International
Position Number: 472324
Job Title: AI Big Data Engineer
Job Location: Troy, MI, USA, 48098
Work Model: Hybrid
Employment Type: Temporary
Estimated Duration (In months): 12
Min Hourly Rate($): 75.00
Max Hourly Rate($): 80.00
Must Have Skills/Attributes: AWS, Azure, Databricks, GCP, Hadoop, Hive, Kafka, Python, Snowflake, Spark, SQL, Tableau, Verbal Communication, Written Communication
Job Description
***Only qualified AI Big Data Engineer candidates located near the Troy, MI area to be considered due to the position requiring an onsite presence***
Qualifications:
• Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field
• At least 5 years of experience in data engineering or a similar role (previous DBA experience is a plus)
• Experience with big data frameworks and tools, such as Spark, Hadoop, Kafka and Hive
• Expert in SQL, including a knowledge of efficient query and schema design, DDL, data modeling and use of stored procedures
• Proficient in at least one programming language, such as Python, Go or Java
• Experience with CI/CD, containerization (ex: docker, K8s) and orchestration (ex: Airflow)
• Experience building production systems with more modern ETL, ELT and data systems, such as AWS Glue, Databricks, Snowflake, Elastic, and Azure Cognitive Search
• Experience deploying data infrastructure on cloud platforms (AWS, Azure, or GCP)
• Strong knowledge of data quality, data governance, and data security principles and practices
• Excellent communication, collaboration, and problem-solving
We are seeking an experienced AI, Big Data Engineer for the MOTOR Information Systems operating group. As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and Kubernetes, to handle large-scale and complex data challenges. You will also collaborate with full stack developers, data scientists, analysts, and stakeholders to ensure data quality, reliability, and usability. You must be comfortable working with huge datasets
Our client is actively building out its AI team. We are looking for people with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest in continuous learning, especially in Cloud Technologies, who are aware of, and follow the latest and best generative AI technologies and trends, can learn by themselves, are self-motivated and value self-directed initiative with technology and AI exploration.
Responsibilities:
• Build automated pipelines to extract and process data from a variety of legacy platforms (predominantly SQL Server), e.g., in stored procedures, Glue processing, etc.
• Implement data-related business logic on modern data platforms, such as AWS Glue, Databricks, and Azure using best practices and industry standards
• Create vector databases, data marts and the data models to support them
• Optimize and monitor the performance, reliability, and security of data systems and processes
• Integrate and transform data from (or to) various sources and formats, such as structured, unstructured, streaming, and batch
• Develop and maintain data quality checks, tests, and documentation
• Support data analysis, reporting, and visualization using tools such as SQL, Python, Tableau and Quicksight
• Research and evaluate new data technologies and trends to improve data solutions and existing capabilities - **Only those lawfully authorized to work in the designated country associated with the position will be considered.**
- **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.
California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).
Rose International maintained good communication during assignments and are very informative through email and phone calls.
Sade, Consultant
It was great working for Rose International. Everyone was extremely helpful.
Rosann, Consultant
Working for Rose International was the most pleasant assignment I have ever had. They were always on top of situations when necessary, and very helpful. I was very proud to be an employee of Rose International, and would recommend anyone to try to work with them.
Melvon, Consultant
It is a great pleasure being a part of the Rose International Team.
Toni, Consultant
Rose is an assembly of people grounded in honesty, truth and dignity for all of its employees and contractors.
Samba, Consultant
EMPLOYEE COMMENTS