Interested to Buy Any Domain ? << Click Here >> for more details...
In a very huge text file, you want to just check if a particular keyword exists. How would you do this using Spark?
- 1 Answers
- 419 Views
- I also Faced
- E-Mail Answers
Answer Posted / Vikas Kumar Pal
"To check if a specific keyword exists in a large text file using Apache Spark, you can use the filter() transformation with regex. Here's an example: nn val textFile = spark.textFile("path/to/your/file")n val containsKeyword = textFile.filter(line => line.matches("[w]+"+keyword+"[w]+"))n val result = containsKeyword.count()n if (result > 0) {n println("Keyword found!")n } else {n println("Keyword not found.")n }n"n
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
