How to Load a Text File into Spark
Loading text files in Spark is a very common task, and luckily it is easy to do. Below are a few examples of loading a text file (located on the…
0 Comments
January 25, 2021
Get the MD5 Hash Code of a File with Java
Getting the hash code of a file is a common programming task. MD5 is a very popular and commonly used hashing algorithm. Getting the MD5 hash code of a file…
January 25, 2021
Generating Fake Data in Java with jFairy
Generating fake data can be a common need when developing applications or loading test data into a database. jFairy is a great fake data generator library built in Java that…
January 25, 2021
How to Create a Fat Jar with Maven
A fat jar or uber jar is a jar that contains the classes of your current project as well as all of the classes on which it depends. For example,…
January 25, 2021
Get List of Objects in S3 Bucket with Java
Often when working with files in S3, you need information about all the items in a particular S3 bucket. Below is an example class that extends the AmazonS3Client class to…
January 25, 2021
Count Unique Elements in Text File with AWK
Counting the distinct/unique elements of text file is a common task. Below is an example of doing this is AWK, using sample_data_1.txt. cat sample_data_1.txt \ | awk 'BEGIN{FS="\t"} NR>1{names[$2]=1} END{print…
January 25, 2021
- Go to the previous page
- 1
- …
- 4
- 5
- 6
- 7