[teiid-issues] [JBoss JIRA] (TEIID-1070) Create Amazon SimpleDB Connector

[Ramesh Reddy (JIRA)]

     [ https://issues.jboss.org/browse/TEIID-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ramesh Reddy resolved TEIID-1070.
---------------------------------

        Labels: CR2  (was: )
    Resolution: Done


1) Changed base assumption where all attributes colon separated lists to plain strings. So every attribute is simple string data type.
2) During the import if a attribute found to have multiple values it will be marked as String Array type.
3) Using the Designer, user has ability to change the data type as they see fit, but be-warned that SimpleDB only does lexicographical compares.
4) Added bulk insert support
5) Added count(*) support.
6) Fixed a bug, where only 100 items would have selected from the Select query. It needed cursoring mechnism
7) Batched the inserts and updates, previously they were done one at a time. Even then these are not atomic operations, as SimpleDB only allows 25 items in a batch.
8) Refactored the connection API 
9) Provided support for Arrays, so when dealing with String[] type one can insert/update/select using array types
10) Made "itemName()" as NAMEINSOURCE for "itemName" column, so that user does not need to quote in their queries
11) Delete of Table will delete the domain now, and re-create it, as opposed to deleting each individual item. This essential with bigger tables.
12) Update/Delete procedures were written to be memory efficient. Previously to do a update operation, all item names are read and saved in a list then each individual item is deleted. Removed need to create intermediate list, which should not not as memory intensive.
13) Added direct query support. It only supports "select"
14) Added support for EVERY - See doc on usage
15) Added support for INTERSECTION - See doc on usage
16) Added support for array based compare
17) Added ORDER BY support - note this is only available when there is WHERE clause
18) Tests and i18n support
                
> Create Amazon SimpleDB Connector 
> ---------------------------------
>
>                 Key: TEIID-1070
>                 URL: https://issues.jboss.org/browse/TEIID-1070
>             Project: Teiid
>          Issue Type: Feature Request
>          Components: Misc. Connectors
>            Reporter: John Doyle
>            Assignee: Ramesh Reddy
>              Labels: CR2
>             Fix For: 8.7
>
>
> We need connectivity to Amazon SimpleDB.  This should be accomplished through a dedicated connector.
> Simple DB presents a few challenges as a Teiid source as it is more like a spreadsheet than a database.  Simple DB "Domains' are like individual worksheets and contain any number of items.  Items however can have any number of attributes, and the attributes do not have to be the same for ever item.  So in a single Domain you can have an item with the attributes Size and Color, and another item with the attributes Color and ExpirationDate.  This presents both modeling issues and SQL execution issues.  None of them are insurmountable, but users will have to understand the issues and design their integration around them. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira