Senior Data Developer | Publicis Groupe

This Senior Data Developer position will focus on designing, developing, and supporting our Hadoop data solutions in Spark and Python (PySpark) while working with other components of the Hadoop ecosystem such as HDFS, Hive, Hue, Impala, Jupyter, and Airflow. A successful candidate will work closely with business and portfolio leads to understand requirements then design and build innovative data solutions.
Duties and Responsibilities
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Design and development centered around PySpark, Python and Hadoop Framework.</li>
<li class=" leading-snug mb-2 pl-2">Working with gigabytes/terabytes of data and must understand the challenges of transforming and enriching such large datasets.</li>
<li class=" leading-snug mb-2 pl-2">Automation of new data source integration processes to evaluate impact on existing products</li>
<li class=" leading-snug mb-2 pl-2">Leverage AI/LLMs to improve data matching techniques</li>
<li class=" leading-snug mb-2 pl-2">Identify opportunities to migrate solutions from On-Prem to AWS Cloud</li>
<li class=" leading-snug mb-2 pl-2">Provide effective solutions to address the business problems – strategic and tactical.</li>
<li class=" leading-snug mb-2 pl-2">Collaboration with team members, project managers, business analysts and QA teams in conceptualizing, estimating and developing new solutions and enhancements.</li>
<li class=" leading-snug mb-2 pl-2">Work closely with the stake holders to define and refine the big data platform to achieve sales, product, and strategic objectives.</li>
<li class=" leading-snug mb-2 pl-2">Collaborate with other technology teams and architects to define and develop cross-function technology stack interactions.</li>
<li class=" leading-snug mb-2 pl-2">Read, extract, transform, stage and load data to multiple targets, including Hadoop and Oracle.</li>
<li class=" leading-snug mb-2 pl-2">Develop scripts around Hadoop framework to automate processes and existing flows.</li>
<li class=" leading-snug mb-2 pl-2">Modify existing programming/code for new requirements.</li>
<li class=" leading-snug mb-2 pl-2">Estimate work, and track progress through SDLC with JIRA/Confluence</li>
<li class=" leading-snug mb-2 pl-2">Unit testing and debugging. Perform root cause analysis (RCA) for any failed processes.</li>
<li class=" leading-snug mb-2 pl-2">Convert business requirements into technical design specifications and execute on them.</li>
<li class=" leading-snug mb-2 pl-2">Participate in code reviews and keep applications/code base in sync with version control (GIT/Bitbucket).</li>
<li class=" leading-snug mb-2 pl-2">Effective communication, self-motivation, and ability to work independently while remaining fully aligned within a distributed team environment.</li>
</ul>
Required Skills
Bachelors Degree in Computer Science (or Engineering equivalent) or Masters with 5+ years of experience with big data ingestion, transformation and staging using the following technologies/principles/methodologies:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Analysis, design and implementation experience with Hadoop distributed frameworks, including Python & Spark (SparkSQL, PySpark), HDFS, Hive, Impala, Hue, Cloudera Hadoop, Zeppelin, Jupyter, etc</li>
<li class=" leading-snug mb-2 pl-2">Extensive experience with large volumes of data (measured in Terabytes/Billions of Transactions)</li>
<li class=" leading-snug mb-2 pl-2">AWS experience (especially related to porting solutions from On-Prem à Cloud)</li>
<li class=" leading-snug mb-2 pl-2">AI project work, and exposure to leveraging LLMs/Machine Learning</li>
<li class=" leading-snug mb-2 pl-2">Proficient knowledge of SQL with any RDBMS</li>
<li class=" leading-snug mb-2 pl-2">Familiarity with RDD and Data Frames within Spark</li>
<li class=" leading-snug mb-2 pl-2">Working knowledge of data analytics</li>
<li class=" leading-snug mb-2 pl-2">Troubleshooting and complex problem-solving skills</li>
<li class=" leading-snug mb-2 pl-2">Working knowledge of Linux/Unix environments and comfort with Unix Shell scripts (ksh, bash)</li>
<li class=" leading-snug mb-2 pl-2">Basic Hadoop administration knowledge</li>
<li class=" leading-snug mb-2 pl-2">DevOps Knowledge is an advantage</li>
<li class=" leading-snug mb-2 pl-2">Ability to work within deadlines and effectively prioritize and execute on tasks</li>
<li class=" leading-snug mb-2 pl-2">Strong communication skills (verbal and written) with ability to communicate across teams, internal and external at all levels</li>
</ul>
Certifications
Any of these:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">CCA Spark and Hadoop Developer.</li>
<li class=" leading-snug mb-2 pl-2">MapR Certified Spark Developer (MCSD).</li>
<li class=" leading-snug mb-2 pl-2">MapR Certified Hadoop Developer (MCHD).</li>
<li class=" leading-snug mb-2 pl-2">HDP Certified Apache Spark Developer.</li>
<li class=" leading-snug mb-2 pl-2">HDP Certified Developer.</li>
</ul>
Preferred Skills
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Technical:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Working knowledge of Oracle databases and PL/SQL.</li>
<li class=" leading-snug mb-2 pl-2">Hadoop Admin & Dev-Ops.</li>
</ul>
</li>
<li class=" leading-snug mb-2 pl-2">Non-Technical:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Good analytical thinking and problem-solving skills.</li>
<li class=" leading-snug mb-2 pl-2">Ability to diagnose and troubleshoot problems quickly.</li>
<li class=" leading-snug mb-2 pl-2">Motivated to learn new technologies, applications, and domains.</li>
<li class=" leading-snug mb-2 pl-2">Possess appetite for learning through exploration and reverse engineering.</li>
<li class=" leading-snug mb-2 pl-2">Strong time management skills.</li>
<li class=" leading-snug mb-2 pl-2">Ability to take full ownership of tasks and projects.</li>
</ul>
</li>
<li class=" leading-snug mb-2 pl-2">Behavioral Attributes:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Team player with excellent interpersonal skills.</li>
<li class=" leading-snug mb-2 pl-2">Good verbal and written communication.</li>
<li class=" leading-snug mb-2 pl-2">Possess Can-Do attitude to overcome any kind of challenges.</li>
</ul>
</li>
</ul>
Salary Range: $75,000.00 – $125,000.00
The application deadline for this job posting is 11/5/2024.
<h3 class=" text-white font-semibold text-lg mb-2">Additional information</h3>
Epsilon at Our CORE
Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Our products accelerate our clients’ ability to harness the power of their first-party data to activate campaigns across channels and devices, with an unparalleled ability to prove outcomes. For decades, we’ve been helping marketers from the world’s top brands personalize experiences for millions of people with our cutting-edge technology, solutions and services. Our best-in-class identity gives brands a clear, privacy-safe view of their customers, which they can use across our suite of digital media, retail media, messaging and loyalty solutions. We process 400+ billion consumer actions each day and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC.
Epsilon has a core set of 5 values that define our culture and guide us to create value for our clients, our people and consumers. We are seeking candidates that align with our company values, demonstrate them and make them meaningful in their day-to-day work:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Act with integrity. We are transparent and have the courage to do the right thing.</li>
<li class=" leading-snug mb-2 pl-2">Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.</li>
<li class=" leading-snug mb-2 pl-2">Innovate with purpose. We shape the market with big ideas that drive big outcomes.</li>
<li class=" leading-snug mb-2 pl-2">Respect all voices. We embrace differences and foster a culture of connection and belonging.</li>
<li class=" leading-snug mb-2 pl-2">Empower with accountability. We trust each other to own and deliver on common goals.</li>
</ul>
Because You Matter
As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to the following:
<ul class=" text-base sm:text-lg marker:text-color list-inside list-disc text-gray-500 list-disc list-outside pl-3 mb-6">
<li class=" leading-snug mb-2 pl-2">Time to Recharge: Flexible time off (FTO), 14 paid holidays</li>
<li class=" leading-snug mb-2 pl-2">Time to Recover: Paid sick time</li>
<li class=" leading-snug mb-2 pl-2">Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance</li>
<li class=" leading-snug mb-2 pl-2">Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling</li>
</ul>
Epsilon benefits are subject to eligibility requirements and other terms.
Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants needing accommodations to complete the application process. Please reach out to <a href="/cdn-cgi/l/email-protection#e5a9808493808a83a48796808b8680a58095968c898a8b868a88" target="_blank" class="break-all font-medium underline hover:opacity-75" rel="noopener noreferrer">LeaveofAbsence@epsilon</a>.com to request an accommodation.
#LI-TL1
REF244260Z

Senior Data Developer | Publicis Groupe | Remote (United States)

Similar Jobs

Recent Jobs

You May Also Like