You're using an older version of Internet Explorer that is no longer supported. Please update your browser.

Big Data Engineer, Omnia AI

Calgary, AB
Full Time
6 days ago
Job Type:   Permanent  
Primary Location:  Calgary, Alberta, Canada  
All Available Locations:  Calgary  
Deloitte Omnia, Deloitte's Artificial Intelligence practice is comprised of specialized experts with hands-on experience, and cutting-edge information assets that facilitate successful Artificial Intelligence (AI) transformations. We develop AI-enabled solutions to address all aspects of a client's transformative journey with disciplined focus on business outcomes.
As a member of our Data & Analytics Modernization team, you will help our clients design and implement the data platform architectures - be it in the cloud, on-premise or hybrid - required to enable cutting-edge AI solutions. You will be part of a practice to deliver a breadth of solutions to solve our clients most challenging business problems, with a focus on Big Data, BI/DW, Data Integration, Data Governance, Master Data and Analytics applications. Each of these applications leverages a different mix of traditional and innovative technologies to achieve business outcomes.
Your role at Deloitte
As a Big Data Engineer, you are passionate about data and technology solutions, are driven to learn about them and keep up with market evolution. You will play an active role throughout the entire engagement cycle, specializing in modern data solutions including data ingestion frameworks, data pipeline development, Hadoop-based data lake architectures and orchestration. You are enthusiastic about all things data, have strong problem-solving and analytical skills, are tech savvy and have a solid understanding of software development.
In this role, you will:
  • Engineer Big Data ingestion and pipeline frameworks to populate on-premise or cloud-based data lakes
  • Translate business rules and requirements into data objects, produce associated data mappings and write abstracted, reusable code components accordingly
  • Plan/schedule tasks, lead small development teams, and mentor junior colleagues
  • Facilitate technical meetings with client staff, and advise client with technical option analyses based on leading practices

  • 3+ years implementation experience leveraging Hadoop ecosystem technologies such as HDFS, MapReduce, Pig, Sqoop, Spark, Hive, Kafka, etc. on-premise and/or in the cloud (e.g. AWS, Azure, GCP)
  • 3+ years experience with analysis, design, development, testing and deployment of data pipeline (ETL) services leveraging the Big Data technology stack for batch and/or real-time messaging/streaming environments
  • 3+ years implementation experience with ingestion, data pipelines, and data lakes using the Azure platform including Azure Data Lake Storage, Azure Data Factory, Azure Databricks and Databricks Delta, etc.
  • Experience writing complex SQL queries, extracting and importing disparate data from source systems, and data manipulation based on requirements
  • Experience with Agile development methods in data-oriented projects
Strong candidates will also have some of the following capabilities:
  • Certifications in data engineering and development from AWS, Azure, GCP and/or Hadoop distributions
  • Programming experience in Spark using modern languages such as Python, Scala and/or Java
  • Experience with implementation of data security, encryption, identity and access management across sources and environments
  • Knowledge of software configuration management environments and tools such as ADO, JIRA, Git, Jenkins, Bitbucket, etc.
  • Bachelor's Degree or higher in quantitative areas such as Computer Science, Information Management, Big Data & Analytics, or related field is desired.
If you believe you have what it takes to be a successful member of our team please apply now. We know your career is important to you and it's important to us, too. The Big Data Engineer role is just the first step of a highly successful career we can help you build.
The time is right for you to join Deloitte. Get your career off to great start. What impact will you make?

Why Deloitte?
Launch your career with The One Firm where you can make a greater impact than you ever thought possible. With endless opportunities at every turn, and a culture built to support and drive our people to be the very best they can be, Deloitte is The One Firm for you to learn, grow, create, and lead.
At Deloitte, we understand that everyone, and their career goals, are different. As a firm, we help create the conditions and opportunities that will enable our people to thrive - both professionally and personally. We do this by making three commitments to our people:
  • You will lead at every level: We grow the world's best leaders so you can achieve the impact you seek, faster.
  • You can work your way: We give you the means to work how you want, and we have innovative spaces and the mindset to help you be wildly successful.
  • You will feel included and inspired: We create a deep sense of belonging where you can bring your whole self to work.
Apply now and let us show you how to push your career to the next level at Deloitte. The One Firm. For You.
Deloitte is an inclusive employer dedicated to building a diverse workforce.  We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective provincial human rights codes throughout all stages of the recruitment and selection process. Please advise the Recruiter to ensure your accessibility needs are accommodated throughout this process.  Information received relating to accommodation will be addressed confidentially.
We thank all applicants in advance for their interest; however, only those candidates selected for an interview will be contacted

Apply now × Apply for Job



Enter your email to apply

Information Technology