Learn how AWS Glue crawler detects the schema
repost.aws/knowledge-center/glue-crawler-detect-schema
Dec 22, 2024
1
Handle duplicate records - Amazon Kinesis Data Streams - https://docs.aws.amazon.com/streams/latest/dev/kinesis-record-processor-duplicates.html
docs.aws.amazon.com/streams/latest/dev/kinesis-record-processor-duplicates.html
Dec 22, 2024
1
Troubleshooting Amazon EventBridge - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-troubleshooting.html#eb-supported-access-policies
docs.aws.amazon.com/eventbridge/latest/userguide/eb-troubleshooting.html
Dec 22, 2024
1
Amazon EventBridge Pipes concepts - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/pipes-concepts.html
docs.aws.amazon.com/eventbridge/latest/userguide/pipes-concepts.html
Dec 22, 2024
1
Amazon EventBridge Pipes - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-pipes.html
docs.aws.amazon.com/eventbridge/latest/userguide/eb-pipes.html
Dec 22, 2024
1
Amazon EventBridge Pipes targets - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-pipes-event-target.html
docs.aws.amazon.com/eventbridge/latest/userguide/eb-pipes-event-target.html
Dec 22, 2024
1
Event bus targets in Amazon EventBridge - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-targets.html
docs.aws.amazon.com/eventbridge/latest/userguide/eb-targets.html
Dec 22, 2024
1
What Is Amazon EventBridge? - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-what-is.html
docs.aws.amazon.com/eventbridge/latest/userguide/eb-what-is.html
Dec 22, 2024
1
Event bus concepts in Amazon EventBridge - Amazon EventBridge - https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-what-is-how-it-works-concepts.html
docs.aws.amazon.com/eventbridge/latest/userguide/eb-what-is-how-it-works-concepts.html
Dec 22, 2024
1
Change data capture for DynamoDB Streams - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Streams.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/Streams.html
Dec 22, 2024
1
Use an external Hive metastore - Amazon Athena - https://docs.aws.amazon.com/athena/latest/ug/connect-to-data-source-hive.html
docs.aws.amazon.com/athena/latest/ug/connect-to-data-source-hive.html
Dec 22, 2024
1
Big Data File Formats
www.clairvoyant.ai/blog/big-data-file-formats
Dec 22, 2024
1
What is AWS Data Exchange? - AWS Data Exchange User Guide - https://docs.aws.amazon.com/data-exchange/latest/userguide/what-is.html
docs.aws.amazon.com/data-exchange/latest/userguide/what-is.html
Dec 22, 2024
2
AWS DataSync FAQs | Amazon Web Services
aws.amazon.com/datasync/faqs/
Dec 22, 2024
1
Using time to live (TTL) in DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/TTL.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/TTL.html
Dec 22, 2024
1
Valkey-, Memcached-, and Redis OSS-Compatible Cache – Amazon ElastiCache – AWS
aws.amazon.com/elasticache/
Dec 22, 2024
2
Object Storage Classes – Amazon S3
aws.amazon.com/s3/storage-classes/
Dec 22, 2024
1
Managing the lifecycle of objects - Amazon Simple Storage Service - https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lifecycle-mgmt.html
docs.aws.amazon.com/AmazonS3/latest/userguide/object-lifecycle-mgmt.html
Dec 22, 2024
1
Partition your data - Amazon Athena - https://docs.aws.amazon.com/athena/latest/ug/partitions.html
docs.aws.amazon.com/athena/latest/ug/partitions.html
Dec 22, 2024
1
Use compression in Athena - Amazon Athena - https://docs.aws.amazon.com/athena/latest/ug/compression-formats.html
docs.aws.amazon.com/athena/latest/ug/compression-formats.html
Dec 22, 2024
1
Query across regions - Amazon Athena - https://docs.aws.amazon.com/athena/latest/ug/querying-across-regions.html
docs.aws.amazon.com/athena/latest/ug/querying-across-regions.html
Dec 22, 2024
1
Amazon S3 + Amazon CloudFront: A Match Made in the Cloud | Amazon Web Services
aws.amazon.com/blogs/networking-and-content-delivery/amazon-s3-amazon-cloudfront-a-match-made-in-the-cloud/
Dec 22, 2024
1
Three AWS Glue ETL job types for converting data to Apache Parquet - AWS Prescriptive Guidance - https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/three-aws-glue-etl-job-types-for-converting-data-to-apache-parquet.html
docs.aws.amazon.com/prescriptive-guidance/latest/patterns/three-aws-glue-etl-job-types-for-converting-data-to-apache-parquet.html
Dec 22, 2024
1
Introduction to Aurora PostgreSQL cluster cache management | Amazon Web Services
aws.amazon.com/blogs/database/introduction-to-aurora-postgresql-cluster-cache-management/
Dec 22, 2024
1
In-memory acceleration with DynamoDB Accelerator (DAX) - Amazon DynamoDB - https://docs.amazonaws.cn/en_us/amazondynamodb/latest/developerguide/DAX.html
docs.amazonaws.cn/en_us/amazondynamodb/latest/developerguide/DAX.html
Dec 22, 2024
1
Improving data access with secondary indexes in DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/SecondaryIndexes.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/SecondaryIndexes.html
Dec 22, 2024
1
General guidelines for secondary indexes in DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-indexes-general.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-indexes-general.html
Dec 22, 2024
1
Top 10 Performance Tuning Tips for Amazon Athena | Amazon Web Services
aws.amazon.com/blogs/big-data/top-10-performance-tuning-tips-for-amazon-athena/
Dec 20, 2024
1
Amazon EFS Infrequent Access | Amazon Web Services
aws.amazon.com/efs/features/infrequent-access/
Dec 20, 2024
1
Best practices for designing and using partition keys effectively in DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-partition-key-design.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-partition-key-design.html
Dec 20, 2024
1
Cheat sheet for DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/CheatSheet.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/CheatSheet.html
Dec 20, 2024
1
Partitions and data distribution in DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.Partitions.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.Partitions.html
Dec 20, 2024
1
Designing partition keys to distribute your workload in DynamoDB - Amazon DynamoDB - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-partition-key-uniform-load.html
docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-partition-key-uniform-load.html
Dec 20, 2024
1
Amazon EBS Volume Types - Amazon Web Services
aws.amazon.com/ebs/volume-types/
Dec 20, 2024
1
Extract multidimensional data from Microsoft SQL Server Analysis Services using AWS Glue | Amazon Web Services
aws.amazon.com/blogs/big-data/extracting-multidimensional-data-from-microsoft-sql-server-analysis-services-using-aws-glue/
Dec 20, 2024
1
Transitioning objects using Amazon S3 Lifecycle - Amazon Simple Storage Service - https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-transition-general-considerations.html
docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-transition-general-considerations.html
Dec 20, 2024
1
Logging Insights events - AWS CloudTrail - https://docs.aws.amazon.com/awscloudtrail/latest/userguide/logging-insights-events-with-cloudtrail.html
docs.aws.amazon.com/awscloudtrail/latest/userguide/logging-insights-events-with-cloudtrail.html
Dec 20, 2024
1
Creating CloudWatch alarms for CloudTrail events: examples - AWS CloudTrail - https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudwatch-alarms-for-cloudtrail.html#cloudwatch-alarms-for-cloudtrail-authorization-failures
docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudwatch-alarms-for-cloudtrail.html
Dec 20, 2024
1
Streaming Data Pipeline - Amazon Firehose - AWS
aws.amazon.com/firehose/
Dec 18, 2024
1
What is Amazon Data Firehose? - Amazon Data Firehose - https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html
docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html
Dec 18, 2024
1
Amazon Kinesis Data Streams Terminology and concepts - Amazon Kinesis Data Streams - https://docs.aws.amazon.com/streams/latest/dev/key-concepts.html
docs.aws.amazon.com/streams/latest/dev/key-concepts.html
Dec 18, 2024
1
Manage event ordering and duplicate events with Amazon S3 Event Notifications | Amazon Web Services
aws.amazon.com/blogs/storage/manage-event-ordering-and-duplicate-events-with-amazon-s3-event-notifications/
Dec 18, 2024
1
Using EventBridge - Amazon Simple Storage Service - https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html
docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html
Dec 18, 2024
1