In the interest of performance, convert the fetcher and uploader to golang and use the minio library, rather than repeated calls to the server with the command line
