Data Engineer 3 - Scala - Big Data - REMOTE

Company: Comcast Corporation
Location: Norristown
Posted on: November 1, 2024

Job Description:

Job SummaryComcast Corporation is a global leader in the media and technology industry, driving innovation to create the world's best entertainment and online experiences. As a Fortune 50 company, we set the pace in various innovative and fascinating businesses, creating career opportunities across a wide range of locations and disciplines. We are at the forefront of change, moving at an amazing pace, thanks to our remarkable people who bring cutting-edge products and services to life for millions of customers every day.Job DescriptionCore Responsibilities

• Communicate with project stakeholders to identify product and technical requirements.
  • Responsible for building data services for audience targeting within the advertising delivery system, linking and integrating various user data silos through data integration, big data processing, and analysis to empower business operations.
    • Proficient coding, debugging, and troubleshooting skills to resolve complex technical issues.
      • Analyze and refine business processes and requirements, implement products, and continuously optimize them to support rapid business growth.
        • Extensively use a combination of several cutting-edge AWS services, 3rd party commercial software, and internally developed software to store, process, and deliver near real-time data. Hands-on experience with AWS services like EMR, EKS, ASG, S3, VPC, subnets, network ACLs, security groups, EC2, S3, IAM, Route 53, Lambda.
          • Support and troubleshoot data and/or system issues. Collaborate with external teams to identify, troubleshoot, and permanently resolve data quality issues. Develop in-house tools to automate common tasks.
            • In-depth knowledge of database structures and SQL. Wrangle huge amounts of data using Apache Spark and other tools to explore new data sets as the business grows.
              • Work with languages like Scala, Golang, Python, Java, Bash, and SQL. Conduct code and design reviews to ensure the product quality remains high.
                • Collaborate with the Data Science team, Data Operations team, and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
                  • Provide technical leadership throughout the design process and guidance on practices, procedures, and techniques. Serves as a guide and mentor for junior level Software Development Engineers.
                    • Share learnings with wider engineering teams by doing technical demos
                      • Other duties and responsibilities as assigned.
                        • Requirements:
                          • Bachelor's or master's degree in computer science or similar field of study.
                            • 2-3+ years of hands-on work in the field of Software development and Big Data( Spark).
                              • Ability to write code in Scala/Java, Python, and Golang(nice to have) with good quality.
                                • Experience with CI/CD tools, Jenkins is preferred.
                                  • Familiar with shell and can work with command lines well, and with a solid foundation in data structures, algorithms, and system design.
                                    • Must be versatile and an inquisitive problem solver.
                                      • Strong skills in SQL and proven experience working with at least one of the major databases platforms. Experience in the media or advertising industry is a huge plus.
                                        • Extra points if you have an AWS certification, and have worked previously on S3, EMR, EKS, Glue, EC2, IAM, Cloudformation, Athena, Lambda, and other AWS services.
                                          • Excellent communication and writing skills. Good team collaboration skills, self-motivated, passionate about learning, with a strong sense of responsibility and efficient delivery.
                                            • Experience in the advertising industry is preferred.
                                              • Experience with graph databases (GraphX, Neo4J) and related analysis is preferred.
                                                • Experience with Kubernetes, Terraform, and ELK is preferred.
                                                  • Experience with Snowflake is preferred.
                                                  • Consistent exercise of independent judgment and discretion in matters of significance.
                                                  • Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) and overtime as necessary.
                                                  • Other duties and responsibilities as assigned.Employees at all levels are expected to:
                                                    • Understand our Operating Principles; make them the guidelines for how you do your job.
                                                    • Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
                                                    • Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
                                                    • Win as a team - make big things happen by working together and being open to new ideas.
                                                    • Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
                                                    • Drive results and growth.
                                                    • Respect and promote inclusion & diversity.
                                                    • Do what's right for each other, our customers, investors and our communities.Disclaimer:
                                                      • This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law, including the Los Angeles Fair Chance Initiative for Hiring Ordinance and the San Francisco Fair Chance Ordinance.Skills:Apache Spark; New Software; Structured Query Language (SQL); Big Data; Software Development; Python (Programming Language)Salary:National Pay Range: $82,219.87 USD-$192,702.83 USDComcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.EducationBachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Relevant Work Experience2-5 Years

Keywords: Comcast Corporation, Wayne , Data Engineer 3 - Scala - Big Data - REMOTE, IT / Software / Systems , Norristown, New Jersey