Amazon dynamodb How to force SSL encryption?

We use the following code to communicate with DynamoDB: using (var client = AWSClientFactory.CreateAmazonDynamoDBClient(RegionEndpoint.USEast1)) { var table = Table.LoadTable(client, "Users"); var item = await table.GetItemAsync(id); } How can I force AWS.SDK for .NET to always use SSL connections? This is very important as we want to store user data including passwords in DynamoDB.

Amazon dynamodb DynamoDB - identity I will never query against

I have been reading about DynamoDB hash, range keys and indices. My use case is simple, but I'm already confused. I want to store 3 values: event ID event timestamp article ID Essentially, this means an article ID was accessed on the timestamp. Event ID uniquely identifies the event, and should allow for now duplicates. I guess this suggests event ID should be my primary key? But I will always query using article ID and timestamp. My only idea is event ID = primary key with article ID an

amazon-dynamodb and filtering by date

I have a dynamodb table which has a GlobalSecondaryIndex with a date field as attribute of keytype "range". Values are stored in ISO-format "YYYY-MM-DD". I want to access in node only records with dates greater than a certain date. It seems to work with a parameter for my query: KeyConditionExpression: 'myDate >= :myDate', ExpressionAttributeValues: { ':myDate': '2017-11-17' } However I do not quite understand. The date is technically speaking a string. Is it reliable to trust the s

Amazon dynamodb Does DynamoDBMapper work with DAX?

I was wondering if DynamoDBMapper can be used to query DAX? I couldn't find any mention of the use of DynamoDBMapper and DAX in the developer guide. It seems like I can pass in the DAX client when constructing an instance of DynamoDBMapper, but since I don't have a provision of DAX, I can't really test it out to see if it works or not.

Amazon dynamodb Scan a table with AWS DynamoDB SDK for Java 2.x

I have a table (users) in Amazon DynamoDB with items like this: { id: "ef1e44bc-03ad-11e9-8eb2-f2801f1b9fd1", // UUID, HASH key version: "3.1", // Version string, conforming to semver standards emailsEnabled: true, // Boolean flag capabilities: { // Big nested object, not important for the question … } } I want to run an ad-hoc scan to tell how many users with version 3.1 have emails enabled. I

Amazon dynamodb Copying parquet data from s3 to dynamodb using glue job

I am trying to copy parquet data in s3 to dynamodb using glue job (spark). The parquet data in s3 is created using glue job from dynamodb. I am getting below error at the last step of the glue job for importing from s3 into DynamoDB. {"service":"AWSGlue","statusCode":400,"errorCode":"InvalidInputException","requestId":"7cf6c14c-2c3b-11ea-878b-8990bca54d25","errorMessage":"No enum constant","type":"AwsServiceError"}

Amazon dynamodb Dynamodb Query/Scan nested documents. Specifying GSI

I have following structure of the DynamoDb document { "studentName"(PK): "Ben", "studendId": 123, "UpdatedTimestamp"(SortKey): 1221432432 "Subjects": [ { SubjectName: "Math" SubjectMarks: 80 UpdatedTimeStamp: 234324324 }, { SubjectName: "History" SubjectMarks: 30 UpdatedTimeStamp: 213234234 } ] } I am currenty using the Dynamodb Mapper to save the documents. I have the following questions Each time I update the table

Amazon dynamodb Error occurred while executing Dynomodb query

Here, is my configuration: Table Name: MY_TABLE Primary partition key method (String) Primary sort key path (String) and I would like to query agains two fields: 1. method (Primary partition key): GET 2. path (Primary sort key): /greet/v1/hello I have used '#pathKey' because 'path' is a reserved keyword. (Similar for #methodKey) aws dynamodb query --table-name MY_TABLE \ --key-condition-expression '#pathKey=:path1 AND #methodKey=:method1' \ --expression-attribute-names '{"#pathKey":"

Amazon dynamodb Dynamoose- error while saving custom type using object: Expected xxx to be of type object, instead found type object

I'm trying to migrate my mongoose code/db to dynamoose/dynamodb. I get the following exception while trying to save custom object: TypeMismatch: Expected name to be of type object, instead found type object Here is my sample code on nodejs / typescript: import dynamoose from "dynamoose"; export = { run: async() => {{ "accessKeyId": "AKID", "secretAccessKey": "SECRET",

Amazon dynamodb dynamodb UpdateItem using API Gateway as Proxy, error

I am using the AWS API Gateway as proxy to expose DynamoDB API. the UpdateItem mapping is not working, it return: { "__type": "" } Below is the mapping template and the payload: { "TableName": "registros", "Key": { "Pk": { "S": "$input.path('$.Pk')" }, "Sk": { "S": "$input.path('$.Sk')&qu

Amazon dynamodb How to future proof these possible requirement changes (swaping primary key columns) with a dynamodb table design?

I have the following data structure item_id String version String _id String data String _id is simply a UUID to identify the item. There is no need to search for a row by this field yet. As of now, item_id, an id generated by an external system, is the a primary key. i.e. Given the item_id, I want to be able retrieve version, _id and data from the dynamodb table. item_id -> (version, _id, data) Therefore I am setting item_id as the partition key. I have two questions for future-pro

Amazon dynamodb What is difference between string, list and list of string in cloudformation?

What is difference between string, list and list of string in cloudformation? When I'm provision NonKeyAttributes in dynamodb using if condition. I got Value of property NonKeyAttributes must be of type List of String when i'm trying to provising new condition z with if condition. Also is there a better way to do this instead of too many if conditions Conditions: x: !Or [ !Equals [ !Ref env, "prod" ], !Equals [ !Ref env, "acpt" ] ] y: !Or [ !Equals [ !Ref env, "infrastr

Amazon dynamodb Querying DynamoDB with list contains condition

Is there any way I can query for any data that has a one of several IDs found in a list? For example, I have a list with groupIds, and I need to query to find all of the posts that fall into any of these groupIds. I can't seem to find any sort of 'or' or 'contains' operator except if I use a scan. Is there any way to get around this?

Amazon dynamodb Amazon Logstash Usage

What is the use of Logstash, and how can I use in my project of containing the dynamodb database. Without using Lambda, we can use Logstash. Was the Logstash work as Lambda or in different process. Please guide me.

Amazon dynamodb DynamoDB OrderBy operation

GSI: price-index[PurchaseType,price] Query with index "price-index" condition: purchasetype="online" and price >500 ScanIndex: true How to get the result based on the following conditions: purchasetype="online" price>500 order by Name

Amazon dynamodb Rollback with DynamoDb?

I have a question, If I insert in DynamoDb 5 o 6 elements, but for example 6º fail. How can I do rollback in dynamoDb ? MyMessage myMessage = new MyMessage(true, "ok"); Article art; for (int i = 0; i < list.size(); i++) { art= (Article) list.get(i); try {; } catch (Exception e) { myMessage.setSuccess(false); myMessage.setMessage("Fail."); } } if(myMessage.isSuccess()) {

Amazon dynamodb How can I cancel DynamoDB Restore

I started restore for DynamoDB table from backup. The table has millions of records and it is taking a long time. I would like to cancel the Restore and I cannot find the option from AWS Console. I tried to delete the table using aws cli and I am greeted with resource is being used error message. Is there a way to cancel restore? Thank you!

Amazon dynamodb DynamodB query starts taking more time when we put more data into table

We have a dynamoDb table with following structure. userId - partition key- number yearOfBirth -attribute number dateOfBirth - attribute(number in millisecond) loginTime - attribute(number in millisecond) and with following gsi - user_gsi yearOfBirth - partition key- number dateOfBirth - sort key (number -in millisecond) loginTime - attribute(number in millisecond) we are using java aws sdk to query the table. Our query requirement is to query all users between two dateOfBirth and between

Amazon dynamodb GraphQL Relay unique id requirement and dynamo composite keys

I am building an AWS AppSync graphQL server connected to DynamoDB which is using composite keys (let's say postID which is totally unique for my HASH and clientID for my RANGE). GraphQL specs ask for a unique ID. In order for me to fetch an item from DynamoDB I need to pass it both. How should I handle the schema in order to follow the graphQL specs? Would I create the graphQL ID build from postID+clientID? Is there a standardized way? It may be possible to I am overreading the specs and tha

Amazon dynamodb Query dynamodb for text search?

I am looking to optimize the dynamodb operations i.e removing scans and use queries to fetch data fastly. Table Data: itemId itemName itemOwners hash1 abc [user1, user2] hash2 abcd [user1, user3] hash3 xyz [user2, user3] I have to do the item search using an item name. Right now, we scan the whole table. let getItems = { TableName: ItemsTable, FilterExpression: 'contains (#itemName, :searchValue)', ExpressionAttributeNames: { '#itemName': 'itemName' }

Amazon dynamodb Order of DynamoDB multiple conditions query

I am studying DynamoDB and confuse on the order. a. Could I use multiple conditions in the KeyConditions field of query command to do the 'AND' query? i.e. Set condition to the following keys: hash part of primary key, range part of primary key, local secondary index 1, b. If it's workable, how would DynamoDB sort the result?

Amazon dynamodb Does Dynamodb have atomic scripts?

Well the title says it. Redis has Lua scripts, in mongodb you can load js scripts. In both cases, running a script will run atomically on the DB/cache. Does Dynamodb has something in that sort? And I don't mean the atomic increment/conditional features that appear in the API but full scripting. Thanks

Amazon dynamodb AWSSDK - DynamoDB delete items by term and add automatic create date attribute

I want to know if there is option to add in creation table automatic attribute or something like this that will save the create date of each "row" in table . I search on amazon documentation and didn't found something like this , I am new with dynamoDB ,and I do not have a lot of knowledge.. So , It's possible ? Another issue - I want delete items (use on DeleteItemRequest) by filter on the date attribute - it's possible ?

Amazon dynamodb Indexing on nested field

I'm trying to create an index on a nested field, using the Dashboard in AWS Developer Console. E.g. if I have the following schema: { 'id': 1, 'nested': { 'mode': 'mode1', 'text': 'nice text' } } I was able to create the index on nested.mode, but whenever I then go to query by index, nothing ever comes back. It makes me think that DynamoDB created the index on a field name nested.mode instead of the mode field of nested. Any hints re. what I might be doing wrong?

Amazon dynamodb Refresh DynamoDB credentials after it is expired

I call the following code to get DynamoDB credentials for my AWS tables. My problem is that after 1 hour my permission expires and when I recall these routines again it does not refresh my credential and can not access database. But if I re-start my app it works. How can I refresh without need to re-start the app? AWSCognitoCredentialsProvider *credentialsProvider = [[AWSCognitoCredentialsProvider alloc] initWithRegionType:AWSRegionU

Amazon dynamodb Data Modeling with NoSQL (DynamoDB)

Coming from a SQL background, I understand the high-level concepts on NoSQL but still having troubles trying to translating some basic usage scenario. I am hoping someone can help. My application simply record a location, a timestamp, and tempature for every second of the day. So we end up having 3 basic columns: 1) location 2) timestamp 3) and temperature (All field are numbers and I'm storing the timestamp as an epoch for easy range querying) I setup dynamodb with the l

Amazon dynamodb create dynamodb table using AWS CLI

I am trying below command after aws --configure command: aws dynamodb create-table --table-name MusicCollection2 --attribute-definitions AttributeName=Artist,AttributeType=S AttributeName=SongTitle,AttributeType=S -- key-schema AttributeName=Artist,KeyType=HASH AttributeName=SongTitle,KeyType=RANGE --provisioned-throughput ReadCapacityUnits=5,WriteCapacityUnits=5 Output: Nothing Please give suggestion how to create dyanmodb table using AWS CLI.

Amazon dynamodb How to solve this exception: "Cannot specify the AttributesToGet when choosing to get ALL_ATTRIBUTES"?

When I'm trying to scan a dynamoDb table and return specific columns using the following example code from AWS page: string tableName = "Thread"; Table ThreadTable = Table.LoadTable(client, tableName); ScanFilter scanFilter = new ScanFilter(); scanFilter.AddCondition("ForumId", ScanOperator.Equal, forumId); scanFilter.AddCondition("Tags", ScanOperator.Contains, "sortkey"); ScanOperationConfig config = new ScanOperationConfig() { AttributesToGet = new List<string> { "Su

Amazon dynamodb Returning Appsync GraphQL type that also has field resolvers

I would like to return the ImageSet type from the AddImageSet mutation. But I seem to be unable to do this because each field on my ImageSet type has it's own resolver, which is overwriting the resolver mapping template. Schema: type ImageSet { SetKey: ID SetName: String SetCreatedAt: AWSTimestamp SetDescription: String SetTags: [Tag] } type Mutation { AddImageSet(setName: String!, setDescription: String): ImageSet } Here is the mutation: { "version" : "2017-02

Amazon dynamodb DynamoDB global index overloading vs sparse indexes

We are designing an application which will use DynamoDB as storage system. We identified the different access patterns and after reviewing Global Secondary Indexes documentation, we got stuck on making a decision about which approach to use: Index overloading or having 2 sparse index. To give more context, our application stores orders, we can have internal or external orders. Based on that, they will be linked to a Customer or a Warehouse: As we would like to search by customer and/or ware

Amazon dynamodb For a DynamoDB eventually consistent query are there any read ordering guarantees?

Consider a scenario where I have a writer process inserting documents into a DynamoDB table. The documents all have the same partition key but different sort keys. The writer inserts document A, B, C, D, E one after the other in that order. Now another reader process does an eventually consistent query to read the documents that have just been inserted. I understand with eventual consistency there is no guarantee the reader will immediately see all the documents inserted. My question is if it is

Amazon dynamodb Create a DynamoDB table from json

I was wondering if its possible to create a dynamodb table from the table definition json itself? I've looked into the aws cli tool and I couldnt find any way of doing this. Just wondering if it's possible. aws dynamodb create-table file://tabledenifision.json Thanks!

Amazon dynamodb How to launch local DynamoDB programmatically?

I am able to launch a local DynamoDB server from bash through this command: java -Djava.library.path=./DynamoDBLocal_lib -jar DynamoDBLocal.jar -sharedDb & Is there not a pure-java way to start the server in one's code? I don't mean a java callout to the shell through the Process object but a way such that when I run my app, the server starts, and when my app is killed, the server is killed. I can live with an embedded database if such a mode exists, though something that reflects server

Amazon dynamodb How to check versions with Json and without using DynamoDBVersion attribute?

In our project we use JSON.NET to serialize our objects and then send them to DynamoDB: public class TestClass { ... public long Version { get; set; } } using (var client = AWSClientFactory.CreateAmazonDynamoDBClient(RegionEndpoint.USEast1)) { var table = Table.LoadTable(client, "MyTable", DynamoDBEntryConversion.V2); var json = JsonConvert.SerializeObject((TestClass) obj); var item = Document.FromJson(json); await table.UpdateItemAsync(item); } The problem with the c

Amazon dynamodb How to add data to dynamodb using lambda which i invoke using rule engine

I am new to AWS IOT. I have created a table in Dynamodb and i have created a Thing in aws iot. I know we can add data to Dynamodb directly using a Rule, But instead I want to Invoke a Rule that calls a lambda function when data arrives to aws iot and and send that data to same lambda function and add the data to Dynamodb using the same lambda function. So how can i do this?

Amazon dynamodb DynamoDB Mapper "batchLoad()" input

I was just using batchLoad function of dynamoDB. Here, the documentation of the function says, the input it takes is List<KeyPair>. But when I use a KeyPair object, it throws the error that the argument should be a dynamodb annotated class. I can use a DynamoDB class, where I set only hashKey and rangeKey attributes of the class and pass them as an argument. But now my use case is the Class(DynamoDB annotated), I am using has @NonNull fields. If I have to pass arguments for this I have

Amazon dynamodb Is safe to set a randomly generated alpha numeric string as primary partition key and sort key in DynamoDB

Here is the sample JSON which we are planning to insert into DynamoDB table. As of now we are having organizationID as primary partition key and __id__ as sort key. Since we will query based on organizationID we kept it as primary partition key. Is it a good approach to keep __id__ as sort key. { "__class__": "package", "__updated__": "2015-10-19T14:30:13Z", "__created__": "2015-10-19T12:32:28Z", "transactions": [ { transaction1 }, { transaction2 } ], "ca

Amazon dynamodb Dynamodb: How do I efficiently query the number of rows in groups of primary keys?

I have a dynamoDB table storing millions and millions of events The table has a primary and a sort key: Primary partition key userID (Number) Primary sort key createdAt (String) A table could look something like this: userID createdAt someAttr 374624 2017-04-17T20:16:41.695884945Z abc 374624 2017-04-16T22:13:12.611114945Z abc 374624 2017-04-20T20:18:15.695874945Z abc 4046 2017-04-15T20:12:01.695814945Z abc 4046 2017-04-17T20:16:22.195684945Z abc 118

Amazon dynamodb Bulk add ttl column to dynamodb table

I have a use case where I need to add ttl column to the existing table. Currently, this table has more than 2 billion records. Is there any existing solution build around same? Or Should be emr is the path forward?

Amazon dynamodb Howto profile performance aws dynamodb calls across many java apps

AWS Dynamodb, lot of literature around scan vs query, using proper GSI vs LSI, etc....but nothing around how to actually analyze/profile (other than manually reviewing each one) if your current query usage patterns are 'ideal' or 'less than ideal'. Are there any practices, dashboards, logging I may be missing to collect which queries may be less than optimal across a wide range of java apps with enough info to tackle the problem (i.e. more than just 'its slow, go figure it out'). :-) thanks!

  1    2   3   4   5   6  ... 下一页 最后一页 共 7 页