Big Data Architect

Virtusa Singapore Private Limited - 3 Changi Business Park Vista Singapore

Roles & Responsibilities
  • Setup, administration, monitoring, tuning, optimizing, governing Large Scale Hadoop Cluster and Hadoop components: On-Premise/Cloud to meet high availability/uptime requirements.
  • Design & implement new components and various emerging technologies in Hadoop Echo System, and successful execution of various Proof-Of-Technology (PoT) / Proof-Of-Concepts (PoC)
  • Collaborate with various cross functional teams: infrastructure, network, database, application for various activities: deployment new hardware/software, environment, capacity uplift etc.
  • Work with various teams to setup new Hadoop users, security and platform governance
  • Create and executive capacity planning strategy process for the Hadoop platform
  • Work on cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Ambari etc.
  • Performance tuning of Hadoop clusters and various Hadoop components and routines.
  • Monitor job performances, file system/disk-space management, cluster & database connectivity, log files, management of backup/security and troubleshooting various user issues.
  • Harden the cluster to support use cases and self-service in 24x7 model and apply advanced troubleshooting techniques to on critical, highly complex customer problems
  • Contribute to the evolving Hadoop architecture of our services to meet changing requirements for scaling, reliability, performance, manageability, and price.
  • Setup monitoring and alerts for the Hadoop cluster, creation of dashboards, alerts, and weekly status report for uptime, usage, issue, etc.
  • Design, implement, test and document performance benchmarking strategy for platform as well for each use cases
  • Act as a liaison between the Hadoop cluster administrators and the Hadoop application development team to identify and resolve issues impacting application availability, scalability, performance, and data throughput.
  • Research Hadoop user issues in a timely manner and follow up directly with the customer with recommendations and action plans
  • Work with project team members to help propagate knowledge and efficient use of Hadoop tool suite and participate in technical communications within the team to share best practices and learn about new technologies and other ecosystem applications
  • Automate deployment and management of Hadoop services including implementing monitoring
  • Drive customer communication during critical events and participate/lead various operational improvement initiatives
Skills & Requirements:
  • 2+ Years of strong Hadoop/Big Data experience with an overall industry experience of 6+ years at various levels with good amount of in Java programming.
  • Able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure  high availability, schedule and configure and take backups.
  • Strong Experience with Hadoop ETL/Data Ingestion: Sqoop, Flume, Hive, Spark, Hbase
  • Experience in Real Time Data Ingestion using Kafka, Storm, Spark or Complex Event Processing (CEP)
  • Experience in Hadoop Data Consumption and Other Components: Hive, Hue HBase, Phoenix, Spark, Mahout, Pig, Impala, Presto
  • Experience monitoring, troubleshooting and tuning services and applications and operational expertise such as good troubleshooting skills, understanding of system?s capacity, bottlenecks, and basics of memory, CPU, OS, storage, and networks.
  • Experience with open source configuration management and deployment tools such as Puppet or Chef and Scripting using Python/Shell/Perl/Ruby/Bash/PowerShell
  • Good understanding of distributed computing environments


Post Date 14 December 2017
End Date 28 December 2017

Other vacancies of Virtusa Singapore Private Limited

Global Mobility Consultant

Global Mobility Consultant

Virtusa Singapore Private Limited - Changi (East) - Changi Business Park
10 hours ago
IT Team Lead / Manager

IT Team Lead / Manager

Virtusa Singapore Private Limited - East - Changi Business Park
21 hours ago
Big Data Architect

Big Data Architect

Virtusa Singapore Private Limited - Changi (East)
21 hours ago
Cloud DevOps Engineer

Cloud DevOps Engineer

Virtusa Singapore Private Limited - East - Changi Business Park
09 Dec - 12:00 AM
IT Unix Production Support Engineer

IT Unix Production Support Engineer

Virtusa Singapore Private Limited - Singapore - Changi Business Park
08 Dec - 3:28 PM
Senior Delivery Manager

Senior Delivery Manager

Virtusa Singapore Private Limited - Changi (East) - Changi Business Park
08 Dec - 12:00 AM
CADIS Developer

CADIS Developer

Virtusa Singapore Private Limited - Singapore - Changi Business Park
08 Dec - 12:00 AM
iOS Mobile Developer

iOS Mobile Developer

Virtusa Singapore Private Limited - Changi (East) - Changi Business Park
07 Dec - 3:20 PM
Techno Functional Business Analyst

Techno Functional Business Analyst

Virtusa Singapore Private Limited - Changi (East) - Changi Business Park
07 Dec - 12:00 AM
iOS Mobile Developer

iOS Mobile Developer

Virtusa Singapore Private Limited - Singapore - Across Singapore
07 Dec - 12:00 AM
FXLM Investor Services

FXLM Investor Services

Virtusa Singapore Private Limited - Changi (East)
07 Dec - 12:00 AM
IT Sales Director

IT Sales Director

Virtusa Singapore Private Limited - East - Changi Business Park
06 Dec - 4:55 PM
Front-End Developer

Front-End Developer

Virtusa Singapore Private Limited - Singapore
05 Dec - 5:02 PM
Pega Business Architect

Pega Business Architect

Virtusa Singapore Private Limited - Changi (East) - Changi Business Park
24 Nov - 12:00 AM
IT Unix Production Support Engineer

IT Unix Production Support Engineer

Virtusa Singapore Private Limited - Singapore - Changi Business Park
21 Nov - 12:00 AM
FXLM Investor Services

FXLM Investor Services

Virtusa Singapore Private Limited - Changi (East)
14 Nov - 12:00 AM

Company Profile

Virtusa Singapore Private Limited

Virtusa Singapore Private Limited

Singapore - East - Changi

VirtusaPolaris serves Global 2000 companies and leading software vendors in banking & financial services, insurance, telecommunications, technology and media, information & education industries. Using a combination of business consulting, cutting edge technology capabilities, and best-of-breed domain and industry knowledge, VirtusaPolaris accelerates business outcomes for its clients.
 
VirtusaPolaris helps its clients transform their business applications to enhance customer experience, improve operational efficiencies, and lower IT costs.
 
VirtusaPolaris helps clients accelerate business outcomes by consolidating, rationalizing, and modernizing their core customer-facing processes into one or more core systems.
 
VirtusaPolaris delivers strongly differentiated solutions to its clients, with a formidable reputation in global consumer banking, treasury, capital markets, and GRC segments within banking & financial services. VirtusaPolaris consistently executes large, business transformation programs, leveraging best of breed domain expertise, including the world's largest P&C claims modernization program, one of the world's largest banking portal for corporate customers, lead-to-cash transformation for a global telco, digital transformation programs for banks and media companies, among many others.
 
VirtusaPolaris delivers cost-effective solutions through a global delivery model, applying advanced methods such as Agile and Accelerated Solution Design to ensure that its solutions meet the clients' requirements. As a result, its clients simultaneously reduce their IT operations cost while increasing their ability to meet changing business needs.
 
With offices and development centers across North America, Europe, Middle East, India, Sri Lanka, South-east Asia, Japan and Australia & New Zealand, and a workforce of approximately 19,000, VirtusaPolaris is strongly placed to become the IT services partner of choice for global clients in the industries it serves.
 
About Virtusa Corporation (www.virtusa.com)
Virtusa Corporation (NASDAQ-GS: VRTU), is a global IT consulting and outsourcing service provider. Founded in 1996 and headquartered in Massachusetts, Virtusa has operations in North America, Europe and Asia.

About Polaris Consulting & Services Ltd. (www.polarisft.com)
Polaris Consulting & Services Ltd (BSE: POLARIS), a majority-owned subsidiary of Virtusa Corporation, is a leader in solutions and services that enable operational productivity for the global banking and financial services industry.
 

Why join with us?

Imagine a work environment that values technological innovation, respects integrity and stimulates enthusiasm. A place where you get a chance to do great work and collaborate alongside some of the brightest people you have ever met!