[teiid-issues] [JBoss JIRA] (TEIID-4622) Adding new data quality functions from osDQ

Steven Hawkins (JIRA) issues at jboss.org
Mon Dec 19 17:44:00 EST 2016


    [ https://issues.jboss.org/browse/TEIID-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13340466#comment-13340466 ] 

Steven Hawkins commented on TEIID-4622:
---------------------------------------

[~rareddy] [~kylin] I want to make sure we're on the same page about the schema/prefix for these functions.  Since it seems like the dependency will be optional, and it's not likely that any will be eligible for pushdown, it seems like a good idea to separate these functions from the rest of the system/SYS functions.  We don't need to go to the extent of adding a new schema as we can just use a prefix (osdq.function) and it will still resolve as expected without the prefix.  Any thoughts?

> Adding new data quality functions from osDQ
> -------------------------------------------
>
>                 Key: TEIID-4622
>                 URL: https://issues.jboss.org/browse/TEIID-4622
>             Project: Teiid
>          Issue Type: Feature Request
>          Components: Common
>    Affects Versions: Open To Community
>         Environment: osdq-core and its dependency simmetric 3.0.0 is needed to run these functions
> maven central location
> http://search.maven.org/#search%7Cga%7C1%7Ca%3A%22osdq-core%22
>            Reporter: vivek singh
>            Assignee: Kylin Soong
>             Fix For: Open To Community
>
>         Attachments: DateUtil.java, NumberUtil.java, StringUtil.java
>
>
> Following functions have been added into osdq-core for integration with teiid.
> String functions :
> // Encrypting  a string using key and AES encryption
> String encrypt ( String val, String key)
> String decrypt ( String val, String key)
> // Fuzzy distance - similarity between two strings
> float levestheindistance ( String a, String b)
> float jarowinklerdistance( String a , String b)
> float cosinedistance (String a, String b)
> // Format check for PII ( personal information)
> boolean isCreditCardFormat(String a)
> boolean isSSNFormat(String a)
> boolean isPhoneFormat(String a)
> boolean isEmailFormat(String a)
> boolean hasWhiteSpace(String a )
> Date Functions
> // converting date into universal recognized format
> long dateToEpoch(java.util.Date date)
> Date epochToDate(long epoch)
> Date epochToDate(long epoch, String TimeZone)
> long diffInSec(date a, date b)
> String convertToFormat ( Date a, String Format)
> Numerical Functions
> // Statistical functions
> double stdDev(Number[] numSeries)
> double range(Number[] numSeries)
> double median(Number[] numSeries)



--
This message was sent by Atlassian JIRA
(v7.2.3#72005)


More information about the teiid-issues mailing list