[teiid-issues] [JBoss JIRA] (TEIID-4284) Implement Salesforce Bulk API for SELECTS to Salesforce Connector

[Steven Hawkins (JIRA)]

    [ https://issues.jboss.org/browse/TEIID-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13305015#comment-13305015 ] 

Steven Hawkins commented on TEIID-4284:
---------------------------------------

>  And the only concern is that the query runs for a really long time (never stopped on its own still) with the below statements in the log

After the initial blocking, the connector will retry the getBatchInfo https://github.com/teiid/teiid/blob/master/connectors/connector-salesforce/src/main/java/org/teiid/resource/adapter/salesforce/SalesforceConnectionImpl.java operation on a fixed interval.  So you should see those logs repeated correct?  

Following https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_using_bulk_query.htm and with my local testing the code expects salesforce to return a state of Completed.  What you are seeing suggests that you are never reaching that state.

> Implement Salesforce Bulk API for SELECTS to Salesforce Connector
> -----------------------------------------------------------------
>
>                 Key: TEIID-4284
>                 URL: https://issues.jboss.org/browse/TEIID-4284
>             Project: Teiid
>          Issue Type: Feature Request
>          Components: Salesforce Connector
>    Affects Versions: 8.13.5
>         Environment: With Salesforce datasource
>            Reporter: sameer P
>            Assignee: Steven Hawkins
>             Fix For: 9.1
>
>
> There is some huge data (many GBs) in the Salesforce which has around 1.5 million rows and doing some simple select * on it fails with QUERY_TIMEOUT.  
> The salesforce guys suggested to try Bulk API for select with PK chunking as stated in https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_code_curl_walkthrough_pk_chunking.htm . 



--
This message was sent by Atlassian JIRA
(v6.4.11#64026)