**Join arenaflex Today: Remote Data Entry Jobs**
At arenaflex, we're on a mission to revolutionize the way we approach data-driven innovation. As a leading player in the industry, we're seeking a highly skilled and motivated Senior Engineer - Big Data to join our team. If you're passionate about harnessing the power of big data to drive business growth, we want to hear from you.
**About arenaflex**
arenaflex is a forward-thinking organization that's dedicated to empowering our customers with cutting-edge technology solutions. Our team of experts is passionate about leveraging the latest advancements in data science, machine learning, and cloud computing to drive business success. We're committed to fostering a culture of innovation, collaboration, and continuous learning, and we're excited to welcome talented individuals like you to our team.
**Job Details**
* **Location:** Remote
* **Compensation:** A competitive salary
* **Position:** Senior Engineer - Big Data
* **Start Date:** Immediate openings available
* **Company:** arenaflex
**Job Description**
As a Senior Engineer - Big Data at arenaflex, you'll play a critical role in shaping our data-driven innovation strategy. You'll be part of a fast-paced, agile team that's dedicated to delivering high-quality solutions using cutting-edge technologies. Your primary responsibilities will include:
* Creating and testing software, including ongoing refactoring of code and driving continuous improvement in code structure and quality
* Spending most of your time writing code, designing APIs, conducting code reviews, and testing in continuous runs or performing proof-of-concepts/automation tooling
* Applying your analytical and problem-solving skills to quickly identify and implement innovative solutions
* Collaborating with cross-functional teams to drive customer story analysis and elaboration, design and development of software applications, testing, and automation tooling
* Working on a specific stage/product or as part of a shared resource pool allocated to projects based on interest and business need
* Identifying opportunities to adopt new and innovative technologies
* Embodying a rebel-with-a-cause mindset by looking beyond the obvious for continuous improvement opportunities
**Essential Qualifications**
* Bachelor's degree in Computer Science, Software Engineering, or a related field
* 2+ years of programming experience and leading teams of developers and scrum teams
* 2+ years of active experience working with Hive, Hadoop, and Spark (core, SQL, and PySpark)
* Demonstrated data warehousing concepts
* Knowledge of financial detailing ecosystem is a plus
* 2+ years of demonstrated experience in data engineering/data warehousing using big data technologies will be an added advantage
* Master's degree in a related field is a plus
* Active involvement in programming using Java or Python/Scala
* Master's degree in Hadoop and Spark design and its functioning guidelines
* Involved experience in writing and understanding refined SQL (Hive/PySpark-dataframes), optimizing joins while handling large amounts of data
* Experience in UNIX shell scripting
* Ability to design and develop advanced data pipelines for batch and real-time data processing
* Should have experience in analysis, design, development, testing, and deployment of system applications
* Proven ability to create and document technical and functional specifications and investigate software and system processing streams
**Preferred Qualifications**
* Knowledge of cloud platforms like GCP/AWS, building Microservices and flexible solutions, will be a plus
* 2+ years of experience in planning and building solutions using Kafka streams or lines
* Experience with GitHub/Bitbucket and using CI/CD pipelines
* Experience with NoSQL i.e., HBase, Couchbase, MongoDB is a plus
* Excellent technical and analytical skills
* Excellent communication and interpersonal skills
* Brilliant project management skills
**Why Join arenaflex?**
At arenaflex, we offer a dynamic and supportive work environment that's designed to foster growth and development. As a member of our team, you'll have access to:
* Competitive salary and benefits package
* Opportunities for career growth and professional development
* Collaborative and innovative work environment
* Flexible working arrangements, including remote work options
* Access to cutting-edge technologies and tools
* Recognition and rewards for outstanding performance
**How to Apply**
If you're a motivated and talented individual who's passionate about big data and innovation, we want to hear from you. Please submit your application without delay. We're excited to hear from talented candidates like you.