{"id":8786,"date":"2025-10-09T14:49:32","date_gmt":"2025-10-09T14:49:32","guid":{"rendered":"https:\/\/pokecon.jp\/job\/?p=8786"},"modified":"2025-10-09T14:49:32","modified_gmt":"2025-10-09T14:49:32","slug":"google-cloud%e3%81%8b%e3%82%89aws%e3%81%b8%e3%81%ae%e3%83%87%e3%83%bc%e3%82%bf%e8%bb%a2%e9%80%81%ef%bc%9a-bigquery%e3%83%87%e3%83%bc%e3%82%bf%e3%82%92amazon-s3%e3%81%ab%e7%a7%bb%e8%a1%8c%e3%81%99","status":"publish","type":"post","link":"https:\/\/pokecon.jp\/job\/8786\/","title":{"rendered":"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 &#8211; \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0"},"content":{"rendered":"\n<\/p>\n<div>\n<p>BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<br \/>\u3044\u304f\u3064\u304b\u65b9\u6cd5\u306f\u3042\u308a\u307e\u3059\u304c\u3001\u672c\u624b\u9806\u3067\u306fAWS Glue Job\u3067BigQuery\u306b\u5bfe\u3057\u30af\u30a8\u30ea\u3092\u5b9f\u884c\u3059\u308b\u3053\u3068\u3067\u30c7\u30fc\u30bf\u3092\u79fb\u884c\u3057\u307e\u3059\u3002<br \/>\u672c\u624b\u9806\u3092\u53d6\u308a\u5165\u308c\u308b\u3053\u3068\u3067\u3001BigQuery\u4e0a\u306e\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u306e\u79fb\u884c\u30fb\u52a0\u5de5\u51e6\u7406\u304c\u30b5\u30fc\u30d0\u30fc\u30ec\u30b9\u3067\u69cb\u7bc9\u3067\u304d\u307e\u3059\u3002<\/p>\n<h3 id=\"\u8ee2\u9001\u5bfe\u8c61\u306e\u30c7\u30fc\u30bf\u306e\u6e96\u5099Google-Cloud\">\u8ee2\u9001\u5bfe\u8c61\u306e\u30c7\u30fc\u30bf\u306e\u6e96\u5099(Google Cloud)<\/h3>\n<p>\u307e\u305a\u306fBigQuery\u30c7\u30fc\u30bf\u3092\u7528\u610f\u3057\u307e\u3057\u3087\u3046\u3002<br \/>\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3068\u30c6\u30fc\u30d6\u30eb\u3092\u4f5c\u6210\u3057\u3001\u30af\u30a8\u30ea\u304c\u5b9f\u884c\u3067\u304d\u3066\u3044\u308c\u3070OK\u3067\u3059\u3002<br \/>\n<span itemscope=\"\" itemtype=\"http:\/\/schema.org\/Photograph\"><img decoding=\"async\" src=\"https:\/\/cdn-ak.f.st-hatena.com\/images\/fotolife\/s\/swx-tsukasa-iwase\/20251008\/20251008121231.png\" width=\"1200\" height=\"553\" loading=\"lazy\" title=\"\" class=\"hatena-fotolife\" itemprop=\"image\"\/><\/span><\/p>\n<h3 id=\"\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u7528\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306e\u4f5c\u6210Google-Cloud\">\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u7528\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306e\u4f5c\u6210(Google Cloud)<\/h3>\n<p>\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u3092\u66f8\u304d\u8fbc\u3080\u3053\u3068\u304c\u3067\u304d\u308b\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<br \/>\u30c7\u30fc\u30bf\u79fb\u884c\u306e\u5ea6\u306b\u66f8\u304d\u8fbc\u307e\u308c\u308b\u306e\u3067\u3001\u5c02\u7528\u306e\u3082\u306e\u3092\u7528\u610f\u3057\u307e\u3057\u3087\u3046\u3002<br \/>\n<span itemscope=\"\" itemtype=\"http:\/\/schema.org\/Photograph\"><img decoding=\"async\" src=\"https:\/\/cdn-ak.f.st-hatena.com\/images\/fotolife\/s\/swx-tsukasa-iwase\/20251008\/20251008122232.png\" width=\"788\" height=\"521\" loading=\"lazy\" title=\"\" class=\"hatena-fotolife\" itemprop=\"image\"\/><\/span><\/p>\n<h3 id=\"IAM\u30ed\u30fc\u30eb\u306e\u4f5c\u6210Google-Cloud\">IAM\u30ed\u30fc\u30eb\u306e\u4f5c\u6210(Google Cloud)<\/h3>\n<p>\u4ee5\u4e0b\u306e\u6a29\u9650\u3092\u6301\u3064IAM\u30ed\u30fc\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<br \/>\u6700\u5c0f\u6a29\u9650\u306e\u539f\u5247\u304b\u3089\u3001\u5f79\u5272\u306b\u5fdc\u3058\u30663\u3064\u306eIAM\u30ed\u30fc\u30eb\u3092\u4f5c\u6210\u3059\u308b\u3053\u3068\u3092\u63a8\u5968\u3057\u307e\u3059\u3002<\/p>\n<p><strong>\u30c6\u30fc\u30d6\u30eb\u53c2\u7167\u7528<\/strong><\/p>\n<pre><code>bigquery.tables.get\nbigquery.tables.getData<\/code>\n<\/pre>\n<p><strong>\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u66f8\u304d\u8fbc\u307f\u7528<\/strong><\/p>\n<pre><code>bigquery.tables.get\nbigquery.datasets.get\nbigquery.tables.create\nbigquery.tables.delete\nbigquery.tables.get\nbigquery.tables.getData\nbigquery.tables.update\nbigquery.tables.updateData<\/code>\n<\/pre>\n<p><strong>\u30bb\u30c3\u30b7\u30e7\u30f3\u4f5c\u6210\u7528<\/strong><\/p>\n<pre><code>bigquery.jobs.create\nbigquery.readsessions.create\nbigquery.readsessions.getData<\/code>\n<\/pre>\n<h3 id=\"\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u306e\u4f5c\u6210Google-Cloud\">\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u306e\u4f5c\u6210(Google Cloud)<\/h3>\n<p>\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<br \/>\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30bb\u30c3\u30b7\u30e7\u30f3\u4f5c\u6210\u7528\u306eIAM\u30ed\u30fc\u30eb\u3092\u5272\u308a\u5f53\u3066\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<p>\u4f5c\u6210\u5f8c\u306f\u3001\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u30ad\u30fc\u3092json\u5f62\u5f0f\u3067\u51fa\u529b\u3057\u3066\u304f\u3060\u3055\u3044\u3002<br \/><strong>\u203b\u5f8c\u307b\u3069AWS Secrets Manager\u3092\u4f7f\u7528\u3057\u3066\u7ba1\u7406\u3057\u307e\u3059\u3002\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u305f\u30d5\u30a1\u30a4\u30eb\u304c\u6d41\u51fa\u3057\u306a\u3044\u3088\u3046\u53d6\u308a\u6271\u3044\u306b\u306f\u3054\u6ce8\u610f\u304f\u3060\u3055\u3044\u3002<\/strong><\/p>\n<h3 id=\"\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3078\u306e\u30a2\u30af\u30bb\u30b9\u6a29\u4ed8\u4e0eGoogle-Cloud\">\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3078\u306e\u30a2\u30af\u30bb\u30b9\u6a29\u4ed8\u4e0e(Google Cloud)<\/h3>\n<p>\u305d\u308c\u305e\u308c\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306b\u4ee5\u4e0b\u306e\u30a2\u30af\u30bb\u30b9\u6a29\u3092\u4ed8\u4e0e\u3057\u307e\u3059\u3002<\/p>\n<p><strong>\u8ee2\u9001\u5bfe\u8c61\u306e\u30c7\u30fc\u30bf\u304c\u3042\u308b\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8<\/strong><\/p>\n<pre><code>\u30d7\u30ea\u30f3\u30b7\u30d1\u30eb\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u306e\u30e1\u30fc\u30eb\u30a2\u30c9\u30ec\u30b9\n\u30ed\u30fc\u30eb\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30c6\u30fc\u30d6\u30eb\u53c2\u7167\u7528\u306eIAM\u30ed\u30fc\u30eb<\/code>\n<\/pre>\n<p><strong>\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u7528\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8<\/strong><\/p>\n<pre><code>\u30d7\u30ea\u30f3\u30b7\u30d1\u30eb\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u306e\u30e1\u30fc\u30eb\u30a2\u30c9\u30ec\u30b9\n\u30ed\u30fc\u30eb\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u66f8\u304d\u8fbc\u307f\u7528\u306eIAM\u30ed\u30fc\u30eb<\/code>\n<\/pre>\n<p><span itemscope=\"\" itemtype=\"http:\/\/schema.org\/Photograph\"><img decoding=\"async\" src=\"https:\/\/cdn-ak.f.st-hatena.com\/images\/fotolife\/s\/swx-tsukasa-iwase\/20251008\/20251008145328.png\" width=\"677\" height=\"452\" loading=\"lazy\" title=\"\" class=\"hatena-fotolife\" itemprop=\"image\"\/><\/span><br \/>\n<span itemscope=\"\" itemtype=\"http:\/\/schema.org\/Photograph\"><img decoding=\"async\" src=\"https:\/\/cdn-ak.f.st-hatena.com\/images\/fotolife\/s\/swx-tsukasa-iwase\/20251008\/20251008145412.png\" width=\"618\" height=\"541\" loading=\"lazy\" title=\"\" class=\"hatena-fotolife\" itemprop=\"image\"\/><\/span><\/p>\n<h3 id=\"AWS-Secrets-Manager\u3067\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u30ad\u30fc\u3092\u7ba1\u7406AWS\">AWS Secrets Manager\u3067\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u30ad\u30fc\u3092\u7ba1\u7406(AWS)<\/h3>\n<p>\u65b0\u3057\u3044\u30b7\u30fc\u30af\u30ec\u30c3\u30c8\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/p>\n<pre><code>\u30b7\u30fc\u30af\u30ec\u30c3\u30c8\u306e\u30bf\u30a4\u30d7\uff1a\u305d\u306e\u4ed6\u306e\u30b7\u30fc\u30af\u30ec\u30c3\u30c8\u306e\u30bf\u30a4\u30d7\n\u30ad\u30fc\/\u5024\u306e\u30da\u30a2\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305fjson\u5f62\u5f0f\u306e\u30b5\u30fc\u30d3\u30b9\u30a2\u30ab\u30a6\u30f3\u30c8\u30ad\u30fc\u3092\u30d7\u30ec\u30fc\u30f3\u30c6\u30ad\u30b9\u30c8\u3068\u3057\u3066\u8cbc\u308a\u4ed8\u3051<\/code>\n<\/pre>\n<h3 id=\"AWS-Glue\u7528\u306eIAM\u30ed\u30fc\u30eb\u306e\u4f5c\u6210AWS\">AWS Glue\u7528\u306eIAM\u30ed\u30fc\u30eb\u306e\u4f5c\u6210(AWS)<\/h3>\n<p>\u65b0\u3057\u3044IAM\u30ed\u30fc\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<br \/>Glue Job\u306e\u5b9f\u884c\u3084s3\u3078\u306e\u30c7\u30fc\u30bf\u683c\u7d0d\u306b\u52a0\u3048\u3001\u4ee5\u4e0b\u306e\u30dd\u30ea\u30b7\u30fc\u3092\u8ffd\u52a0\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<pre><code>{\n  \"Effect\": \"Allow\",\n  \"Action\": \"secretsmanager:GetSecretValue\",\n  \"Resource\": \"\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30b7\u30fc\u30af\u30ec\u30c3\u30c8\u306eARN\"\n}<\/code>\n<\/pre>\n<h3 id=\"AWS-Glue-Connection\u306e\u4f5c\u6210AWS\">AWS Glue Connection\u306e\u4f5c\u6210(AWS)<\/h3>\n<p>\u65b0\u3057\u3044Glue Connection\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/p>\n<pre><code>Data sources\uff1aGoogle BigQuery\nProjectId\uff1a\u8ee2\u9001\u5bfe\u8c61\u306e\u30c7\u30fc\u30bf\u304c\u3042\u308bGoogleCloud\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u306eID\nIAM Role ARN\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305fGlue\u7528\u306eIAM\u30ed\u30fc\u30eb\u306eARN\nAuthentication\uff1aSelect secret from this account\u3092\u9078\u629e\u3057\u3001\u5148\u307b\u3069\u4f5c\u6210\u3057\u305f\u30b7\u30fc\u30af\u30ec\u30c3\u30c8\u306eARN\u3092\u9078\u629e<\/code>\n<\/pre>\n<p><span itemscope=\"\" itemtype=\"http:\/\/schema.org\/Photograph\"><img decoding=\"async\" src=\"https:\/\/cdn-ak.f.st-hatena.com\/images\/fotolife\/s\/swx-tsukasa-iwase\/20251008\/20251008150610.png\" width=\"1200\" height=\"581\" loading=\"lazy\" title=\"\" class=\"hatena-fotolife\" itemprop=\"image\"\/><\/span><\/p>\n<h3 id=\"AWS-Glue-Job\u306e\u4f5c\u6210\u5b9f\u884cAWS\">AWS Glue Job\u306e\u4f5c\u6210\u30fb\u5b9f\u884c(AWS)<\/h3>\n<p>\u65b0\u3057\u3044Glue Job\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<br \/>Job details\u304b\u3089\u4ee5\u4e0b\u3092\u8a2d\u5b9a\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<pre><code>Basic properties \nJob name\uff1a\u4efb\u610f\nIAM Role \uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305fGlue\u7528\u306eIAM\u30ed\u30fc\u30eb\n\nAdvanced properties\nConnections\uff1a\u5148\u307b\u3069\u4f5c\u6210\u3057\u305fGlue Connection<\/code>\n<\/pre>\n<p>\u4ee5\u4e0b\u306e\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u7de8\u96c6\u3057\u3001Script\u306b\u8cbc\u308a\u4ed8\u3051\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<pre><code>import sys\nfrom awsglue.utils import getResolvedOptions\nfrom pyspark.context import SparkContext\nfrom awsglue.context import GlueContext\nfrom awsglue.job import Job\n\nargs = getResolvedOptions(sys.argv, ['JOB_NAME'])\nsc = SparkContext()\nglueContext = GlueContext(sc)\njob = Job(glueContext)\njob.init(args['JOB_NAME'])\n\nquery = '\u5b9f\u884c\u3057\u305f\u3044\u30af\u30a8\u30ea'\n\nbigquery_read = glueContext.create_dynamic_frame.from_options(\n    connection_type=\"bigquery\",\n    connection_options={\n        \"connectionName\": '\u5148\u307b\u3069\u4f5c\u6210\u3057\u305fGlue Connection',\n        \"parentProject\": '\u8ee2\u9001\u5bfe\u8c61\u306e\u30c7\u30fc\u30bf\u304c\u3042\u308bGoogleCloud\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u306eID',\n        \"materializationDataset\": \"\u30de\u30c6\u30ea\u30a2\u30e9\u30a4\u30ba\u30c9\u30d3\u30e5\u30fc\u7528\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\",\n        \"viewsEnabled\": \"true\",\n        \"sourceType\": \"query\",\n        \"query\": query\n    }\n)\n\nglueContext.write_dynamic_frame.from_options(\n    frame=bigquery_read,\n    connection_type=\"s3\",\n    connection_options={\n        \"path\": '\u51fa\u529b\u5148\u306es3\u30d1\u30b9',\n    },\n    format=\"parquet\"\n)\n\njob.commit()<\/code>\n<\/pre>\n<p>\u30b9\u30af\u30ea\u30d7\u30c8\u4f8b<\/p>\n<pre><code>import sys\nfrom awsglue.utils import getResolvedOptions\nfrom pyspark.context import SparkContext\nfrom awsglue.context import GlueContext\nfrom awsglue.job import Job\n\nargs = getResolvedOptions(sys.argv, ['JOB_NAME'])\nsc = SparkContext()\nglueContext = GlueContext(sc)\njob = Job(glueContext)\njob.init(args['JOB_NAME'])\n\nquery = \"\"\"\nSELECT\n  *\nFROM `sample-project.sample-dataset.sample-table`\n\"\"\"\n\nbigquery_read = glueContext.create_dynamic_frame.from_options(\n    connection_type=\"bigquery\",\n    connection_options={\n        \"connectionName\": \"sample-connection\",\n        \"parentProject\": \"sample-project\",\n        \"materializationDataset\": \"sample-materialize-dataset\",\n        \"viewsEnabled\": \"true\",\n        \"sourceType\": \"query\",\n        \"query\": query\n    }\n)\n\nglueContext.write_dynamic_frame.from_options(\n    frame=bigquery_read,\n    connection_type=\"s3\",\n    connection_options={\n        \"path\": \"s3:\/\/sample-bucket\/sample-prefix\/\",\n    },\n    format=\"parquet\"\n)\n\njob.commit()<\/code>\n<\/pre>\n<p>Save\u3001Run\u3092\u62bc\u4e0b\u3059\u308b\u3053\u3068\u3067Glue Job\u304c\u5b9f\u884c\u3055\u308c\u3001BigQuery\u30c7\u30fc\u30bf\u304cAmazon S3\u306b\u8ee2\u9001\u3055\u308c\u307e\u3059\u3002<\/p>\n<h3 id=\"\u53c2\u8003\">\u53c2\u8003<\/h3>\n<p>AWS\u516c\u5f0f\u30b5\u30a4\u30c8<br \/>\n<iframe src=\"https:\/\/hatenablog-parts.com\/embed?url=https%3A%2F%2Fdocs.aws.amazon.com%2Fja_jp%2Fglue%2Flatest%2Fdg%2Faws-glue-programming-etl-connect-bigquery-home.html\" title=\"BigQuery \u63a5\u7d9a - AWS Glue\" class=\"embed-card embed-webcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 155px; max-width: 500px; margin: 10px 0px;\" loading=\"lazy\"><\/iframe><cite class=\"hatena-citation\"><a target=\"_blank\" href=\"https:\/\/docs.aws.amazon.com\/ja_jp\/glue\/latest\/dg\/aws-glue-programming-etl-connect-bigquery-home.html\">docs.aws.amazon.com<\/a><\/cite><\/p>\n<\/div>\n<p><script>(function(d, s, id) {\n  var js, fjs = d.getElementsByTagName(s)[0];\n  if (d.getElementById(id)) return;\n  js = d.createElement(s); js.id = id;\n  js.src = \"\/\/connect.facebook.net\/ja_JP\/sdk.js#xfbml=1&version=v17.0\";\n  fjs.parentNode.insertBefore(js, fjs);\n}(document, 'script', 'facebook-jssdk'));<\/script><br \/>\n<br \/>\n<br \/><a href=\"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039\">\u5143\u306e\u8a18\u4e8b\u3092\u78ba\u8a8d\u3059\u308b <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002\u3044\u304f\u3064\u304b\u65b9\u6cd5\u306f\u3042\u308a\u307e\u3059\u304c\u3001\u672c\u624b\u9806\u3067\u306fAWS Glue Job\u3067BigQuery\u306b\u5bfe\u3057\u30af\u30a8\u30ea\u3092\u5b9f\u884c\u3059\u308b\u3053\u3068\u3067\u30c7\u30fc\u30bf\u3092\u79fb\u884c\u3057\u307e\u3059\u3002\u672c\u624b\u9806\u3092\u53d6\u308a\u5165\u308c\u308b\u3053\u3068\u3067 [&hellip;]","protected":false},"author":1,"featured_media":5011,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[4],"tags":[],"class_list":["post-8786","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-company-tec"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 - \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0 - \u30dd\u30b1\u30b3\u30f3<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039\" \/>\n<meta property=\"og:locale\" content=\"ja_JP\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 - \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0 - \u30dd\u30b1\u30b3\u30f3\" \/>\n<meta property=\"og:description\" content=\"BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002\u3044\u304f\u3064\u304b\u65b9\u6cd5\u306f\u3042\u308a\u307e\u3059\u304c\u3001\u672c\u624b\u9806\u3067\u306fAWS Glue Job\u3067BigQuery\u306b\u5bfe\u3057\u30af\u30a8\u30ea\u3092\u5b9f\u884c\u3059\u308b\u3053\u3068\u3067\u30c7\u30fc\u30bf\u3092\u79fb\u884c\u3057\u307e\u3059\u3002\u672c\u624b\u9806\u3092\u53d6\u308a\u5165\u308c\u308b\u3053\u3068\u3067 [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039\" \/>\n<meta property=\"og:site_name\" content=\"\u30dd\u30b1\u30b3\u30f3\" \/>\n<meta property=\"article:published_time\" content=\"2025-10-09T14:49:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pokecon.jp\/job\/wp-content\/uploads\/2025\/08\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1\" \/>\n\t<meta property=\"og:image:height\" content=\"1\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"info@pokecon.jp\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u57f7\u7b46\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"info@pokecon.jp\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593\" \/>\n\t<meta name=\"twitter:data2\" content=\"2\u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/8786\\\/\"},\"author\":{\"name\":\"info@pokecon.jp\",\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/#\\\/schema\\\/person\\\/16c9f07b1ba984d165d9aee259bda997\"},\"headline\":\"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 &#8211; \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0\",\"datePublished\":\"2025-10-09T14:49:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/8786\\\/\"},\"wordCount\":76,\"image\":{\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png\",\"articleSection\":[\"\u4f01\u696d\u30c6\u30c3\u30af\"],\"inLanguage\":\"ja\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/8786\\\/\",\"url\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039\",\"name\":\"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 - \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0 - \u30dd\u30b1\u30b3\u30f3\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png\",\"datePublished\":\"2025-10-09T14:49:32+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/#\\\/schema\\\/person\\\/16c9f07b1ba984d165d9aee259bda997\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#breadcrumb\"},\"inLanguage\":\"ja\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#primaryimage\",\"url\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png\",\"contentUrl\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blog.serverworks.co.jp\\\/2025\\\/10\\\/09\\\/185039#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u30db\u30fc\u30e0\",\"item\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 &#8211; \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/#website\",\"url\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/\",\"name\":\"\u30dd\u30b1\u30b3\u30f3\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ja\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/#\\\/schema\\\/person\\\/16c9f07b1ba984d165d9aee259bda997\",\"name\":\"info@pokecon.jp\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2b0549cd9f7907c092ca5fbb283baf72337f235726e4b46fa39ec0b701ac2fe2?s=96&d=wavatar&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2b0549cd9f7907c092ca5fbb283baf72337f235726e4b46fa39ec0b701ac2fe2?s=96&d=wavatar&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2b0549cd9f7907c092ca5fbb283baf72337f235726e4b46fa39ec0b701ac2fe2?s=96&d=wavatar&r=g\",\"caption\":\"info@pokecon.jp\"},\"url\":\"https:\\\/\\\/pokecon.jp\\\/job\\\/author\\\/infopokecon-jp\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 - \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0 - \u30dd\u30b1\u30b3\u30f3","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039","og_locale":"ja_JP","og_type":"article","og_title":"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 - \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0 - \u30dd\u30b1\u30b3\u30f3","og_description":"BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002\u3044\u304f\u3064\u304b\u65b9\u6cd5\u306f\u3042\u308a\u307e\u3059\u304c\u3001\u672c\u624b\u9806\u3067\u306fAWS Glue Job\u3067BigQuery\u306b\u5bfe\u3057\u30af\u30a8\u30ea\u3092\u5b9f\u884c\u3059\u308b\u3053\u3068\u3067\u30c7\u30fc\u30bf\u3092\u79fb\u884c\u3057\u307e\u3059\u3002\u672c\u624b\u9806\u3092\u53d6\u308a\u5165\u308c\u308b\u3053\u3068\u3067 [&hellip;]","og_url":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039","og_site_name":"\u30dd\u30b1\u30b3\u30f3","article_published_time":"2025-10-09T14:49:32+00:00","og_image":[{"url":"https:\/\/pokecon.jp\/job\/wp-content\/uploads\/2025\/08\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png","width":1,"height":1,"type":"image\/png"}],"author":"info@pokecon.jp","twitter_card":"summary_large_image","twitter_misc":{"\u57f7\u7b46\u8005":"info@pokecon.jp","\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593":"2\u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#article","isPartOf":{"@id":"https:\/\/pokecon.jp\/job\/8786\/"},"author":{"name":"info@pokecon.jp","@id":"https:\/\/pokecon.jp\/job\/#\/schema\/person\/16c9f07b1ba984d165d9aee259bda997"},"headline":"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 &#8211; \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0","datePublished":"2025-10-09T14:49:32+00:00","mainEntityOfPage":{"@id":"https:\/\/pokecon.jp\/job\/8786\/"},"wordCount":76,"image":{"@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#primaryimage"},"thumbnailUrl":"https:\/\/pokecon.jp\/job\/wp-content\/uploads\/2025\/08\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png","articleSection":["\u4f01\u696d\u30c6\u30c3\u30af"],"inLanguage":"ja"},{"@type":"WebPage","@id":"https:\/\/pokecon.jp\/job\/8786\/","url":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039","name":"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 - \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0 - \u30dd\u30b1\u30b3\u30f3","isPartOf":{"@id":"https:\/\/pokecon.jp\/job\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#primaryimage"},"image":{"@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#primaryimage"},"thumbnailUrl":"https:\/\/pokecon.jp\/job\/wp-content\/uploads\/2025\/08\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png","datePublished":"2025-10-09T14:49:32+00:00","author":{"@id":"https:\/\/pokecon.jp\/job\/#\/schema\/person\/16c9f07b1ba984d165d9aee259bda997"},"breadcrumb":{"@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#breadcrumb"},"inLanguage":"ja","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039"]}]},{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#primaryimage","url":"https:\/\/pokecon.jp\/job\/wp-content\/uploads\/2025\/08\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png","contentUrl":"https:\/\/pokecon.jp\/job\/wp-content\/uploads\/2025\/08\/https3A2F2Fcdn.user_.blog_.st-hatena.com2Fdefault_entry_og_image2F1558446992F1589415473304665.png"},{"@type":"BreadcrumbList","@id":"https:\/\/blog.serverworks.co.jp\/2025\/10\/09\/185039#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u30db\u30fc\u30e0","item":"https:\/\/pokecon.jp\/job\/"},{"@type":"ListItem","position":2,"name":"Google Cloud\u304b\u3089AWS\u3078\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\uff1a BigQuery\u30c7\u30fc\u30bf\u3092Amazon S3\u306b\u79fb\u884c\u3059\u308b\u65b9\u6cd5 &#8211; \u30b5\u30fc\u30d0\u30fc\u30ef\u30fc\u30af\u30b9\u30a8\u30f3\u30b8\u30cb\u30a2\u30d6\u30ed\u30b0"}]},{"@type":"WebSite","@id":"https:\/\/pokecon.jp\/job\/#website","url":"https:\/\/pokecon.jp\/job\/","name":"\u30dd\u30b1\u30b3\u30f3","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/pokecon.jp\/job\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ja"},{"@type":"Person","@id":"https:\/\/pokecon.jp\/job\/#\/schema\/person\/16c9f07b1ba984d165d9aee259bda997","name":"info@pokecon.jp","image":{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/secure.gravatar.com\/avatar\/2b0549cd9f7907c092ca5fbb283baf72337f235726e4b46fa39ec0b701ac2fe2?s=96&d=wavatar&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/2b0549cd9f7907c092ca5fbb283baf72337f235726e4b46fa39ec0b701ac2fe2?s=96&d=wavatar&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2b0549cd9f7907c092ca5fbb283baf72337f235726e4b46fa39ec0b701ac2fe2?s=96&d=wavatar&r=g","caption":"info@pokecon.jp"},"url":"https:\/\/pokecon.jp\/job\/author\/infopokecon-jp\/"}]}},"_links":{"self":[{"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/posts\/8786","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/comments?post=8786"}],"version-history":[{"count":1,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/posts\/8786\/revisions"}],"predecessor-version":[{"id":8787,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/posts\/8786\/revisions\/8787"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/media\/5011"}],"wp:attachment":[{"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/media?parent=8786"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/categories?post=8786"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pokecon.jp\/job\/wp-json\/wp\/v2\/tags?post=8786"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}