How to debug Hadoop code?



How to debug Hadoop code?..

Answer / Anil Kumar Bharti

Debugging Hadoop code can be achieved by using tools like Hadoop's built-in debugger, or external tools such as Eclipse or IntelliJ IDEA. To use the built-in debugger, set the '-Dcom.sun.management.jdp.vmservice' flag when starting the Hadoop job, and use the jdb command in the mapper or reducer script. For external tools, you can attach them to the running JobTracker process.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Hadoop General Interview Questions

Explain what happens in text format?

1 Answers  


Why do we need Hadoop?

1 Answers  


What is the block size in Hadoop?

1 Answers  


List of some best tools that can be useful for data-analysis?

1 Answers  


How will you write a custom partitioner for a Hadoop job?

1 Answers  


What is the role of the secondary namenode?

1 Answers  


What does block mean?

1 Answers  


When we send a data to a node, do we allow settling in time, before sending another data to that node?

1 Answers  


What happens if one hadoop client renames a file or a directory containing this file while another client is still writing into it?

1 Answers  


What is the difference between an inputsplit and a block?

1 Answers  


What does the mapred.job.tracker command do?

1 Answers  


Where are Hadoop’s configuration files located?

1 Answers  


Categories