Testing 3Vs (Volume, Variety and Velocity) of Big Data - QAI
Testing 3Vs (Volume, Variety and Velocity) of Big Data - QAI
Testing 3Vs (Volume, Variety and Velocity) of Big Data - QAI
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Velocity</strong> <strong>Testing</strong>: Approach<br />
Validation Points<br />
• Performance <strong>of</strong> Pig/Hive jobs <strong>and</strong><br />
capture<br />
• Job completion time <strong>and</strong> validating<br />
against the benchmark<br />
• Throughput <strong>of</strong> the jobs<br />
• Impact <strong>of</strong> background processes on<br />
performance <strong>of</strong> the system<br />
• Memory <strong>and</strong> CPU details <strong>of</strong> task<br />
tracker<br />
• Availability <strong>of</strong> name node <strong>and</strong> data<br />
nodes<br />
Metrics Captured<br />
• Job completion time<br />
• Throughput<br />
• Memory utilization<br />
• No. <strong>of</strong> spills <strong>and</strong><br />
spilled records<br />
• Identify Jobs failure<br />
rate<br />
20
Change language