Get Input File name in Hive Query
Often times it is useful to know the input file name you are processing in a Hive query. This is a common if useful metadata is stored in the file…
0 Comments
January 25, 2021
Get List of Objects in S3 Bucket with Java
Often when working with files in S3, you need information about all the items in a particular S3 bucket. Below is an example class that extends the AmazonS3Client class to…
January 25, 2021
Using UNIX Wildcards with AWS S3 (AWS CLI)
Currently AWS CLI doesn’t provide support for UNIX wildcards in a command’s “path” argument. However, it is quite easy to replicate this functionality using the --exclude and --include parameters available…
January 25, 2021