top of page

AWS S3 file copy

  • Writer: Jatin Madaan
    Jatin Madaan
  • Mar 10, 2019
  • 1 min read

To copy files on local machine we can use command :


aws s3 cp s3://bucket_name/folder_name/file_name.txt .

there is a dot at end to signify that file must be stored in current working directory from where command was run .


To store in specified folder just write :


aws s3 cp s3://bucket_name/folder_name/file_name.txt /absolute_path_to_file_on_server



These commands would run without any issue on EMR machines , but to run these commands on your system we would need to configure keys and install clients on system first .



Recent Posts

See All
Accessing Oracle using PySpark .

To run oracle commands on oracle server using pyspark . For EMR First install software sudo su pip install cx_Oracle==6.0b1 Function 1 :...

 
 
 
Hadoop fs commands on S3

We can perform almost all hadoop fs commands on s3 file system as well. Eg : hadoop fs -du -s -h s3://bucket_name/folder_name 10.1 G ...

 
 
 
AWS key for Terminal on Mac

To connect aws cluster (EMR or EC2) via terminal on mac . First make sure you download pem file from aws account. Once file has been...

 
 
 

Comentários


  • linkedin

©2019 by Jatinmadaan

bottom of page