I need to retrieve an public object URL directly after uploading a file, this to be able to store it in a database. This is my upload code:
s3 = boto3.resource('s3')
s3bucket.upload_file(filepath, objectname, ExtraArgs={'StorageClass': 'STANDARD_IA'})
I am not looking for a presigned URL, just the URL that always will be publicly accessable over https.
Any help appreciated.
There's no simple way but you can construct the URL from the region where the bucket is located (get_bucket_location), the bucket name and the storage key:
bucket_name = "my-aws-bucket"
key = "upload-file"
s3 = boto3.resource('s3')
bucket = s3.Bucket(bucket_name)
bucket.upload_file("upload.txt", key)
location = boto3.client('s3').get_bucket_location(Bucket=bucket_name)['LocationConstraint']
url = "https://s3-%s.amazonaws.com/%s/%s" % (location, bucket_name, key)
Since 2010 you can use a virtual-hosted style S3 url, i.e. no need to mess with region specific urls:
url = f'https://{bucket}.s3.amazonaws.com/{key}'
With quoted key :
url = f'''https://{bucket}.s3.amazonaws.com/{urllib.parse.quote(key, safe="~()*!.'")}'''
Moreover, support for the path-style model (region specific urls) continues for buckets created on or before September 30, 2020. Buckets created after that date must be referenced using the virtual-hosted model.
See also this blog post.
Concatenating the the raw key will fail for some special characters in the key(ex: '+'), you have to quote them:
url = "https://s3-%s.amazonaws.com/%s/%s" % (
location,
bucket_name,
urllib.parse.quote(key, safe="~()*!.'"),
)
Or you can call:
my_config = Config(signature_version = botocore.UNSIGNED)
url = boto3.client("s3", config=my_config).generate_presigned_url(
"get_object", ExpiresIn=0, Params={"Bucket": bucket_name, "Key": key}
)
...as described here.