Files
2025-02-06 20:33:26 +02:00

984 KiB

1issuekeytitledescriptionstorypoint
2TDQ-249SQL Server Single Sign On Support doesn't work in data profiler repository connectionsIn the data profiler perspective, you can't use the Single Sign on libraries to connect to SQL Server, even if the library is loaded. We've used the Single Sign On capabilities in the job designer and haven't had any issues running jobs, using the data viewer, etc; however, when you switch to the data profiler, the connection returns that the library isn't loaded, and to check the java.library.path system property - which has the values appropriate for the library. Everyone has installed the dll from the jtds project in their library paths.3
3TDQ-309Remove two columns in frequency tablesin the "b01_column_basic.jrxml" report, frequency tables must not have the following columns: "INDICATOR OK" and "INDICATOR PERC OK" See screenshot. TODO: remove these columns in all kind of frequency table.8
4TDQ-2018Connection analysis : information_schemaWhen you create an connection analysis on mysql, you can retrieve informations from all databases except information_schema where data are 0 or NaN. But i have tables and data in this schema5
5TDQ-2699multiple analysis indicators are "grayed out" and cannot be usedWhen attempting to analyze DB2 table columns, not all analysis indicators are available3
6TDQ-1816"View invalid rows" menu does not display on a table analysis (with DQ Rule)If the DQ Rule has a "join condition", it is impossible to view the "invalid rows" from the analysis results: the option is not displayed. See the screen captures.8
7TDQ-2350Hide MDM connection in the Data Explorer perspectiveI have a MDM connection in my DQ repository and a Mysql connection. When I switch to the Data explorer perspective and try to open a "new SQL Editor", I got the exception shown in the screen capture. "c" is an MDM connection. We should hide MDM connection from the Data Explorer perspective.3
8TDQ-2045Reload database list on MDM connection doesn't work"Reload database list" action on MDM connection doesn't work.20
9TDQ-616list of patterns does not display foldersSee bug:10936 It is working correctly in 4.0.0M3 but it's not working in 4.0.0.3
10TDQ-655Improve the error message when I declare the Data Profiler reporting DBIf I declare a DB into preferences on Data Profiler reporting I have an error with no message. (with no grant access on the user). Is it possible to add a better message than this picture ?5
11TDQ-1901Import Oracle synonyms in to MetadataHi, Request you to include the feature to import Synonyms from Oracle database along with Tables and views in to the Metadata Tree under DB Connections and then be able to create and run analysis on the Synonym. Thanks, Chandana Busetty40
12TDQ-785After Time correlation analysis running, my studio got stuckcreate a new Time correlation analysis, use "tbi" database, "customer" table, "birthday" and "date_accnt_opened" column(which contains NULL value), run this analysis after that, while I want to do any other operation, the studio will be very slowly I'm not sure the reason, but mzhao told me, perhaps it's about the column which contains NULL value...8
13TDQ-854analysis run by right click, the summary section not rightopen an analysis, and run it by right click -- "Run" the summary information not right for eg: the "Number of Execution" should +1 but it's not, if I run with the toolbar button in the editor area, it will +2 take a look at testlink case ...3
14TDQ-855after preview some data, will get some errorsright click on a table or a column, select "preview" the result was right, and seems nothing serious but at "Error Log" view will get this tack :: org.eclipse.swt.SWTException: Failed to execute runnable (org.eclipse.swt.SWTException: Widget is disposed) at org.eclipse.swt.SWT.error(SWT.java:3884) at org.eclipse.swt.SWT.error(SWT.java:3799) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:3468) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3115) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2405) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2369) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2221) at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:500) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:493) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.datacleansing.core.ui.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:194) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:368) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:559) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:514) at org.eclipse.equinox.launcher.Main.run(Main.java:1311) Caused by: org.eclipse.swt.SWTException: Widget is disposed at org.eclipse.swt.SWT.error(SWT.java:3884) at org.eclipse.swt.SWT.error(SWT.java:3799) at org.eclipse.swt.SWT.error(SWT.java:3770) at org.eclipse.swt.widgets.Widget.error(Widget.java:450) at org.eclipse.swt.widgets.Widget.checkWidget(Widget.java:388) at org.eclipse.swt.widgets.Tree.getSelection(Tree.java:1709) at org.eclipse.jface.viewers.TreeViewer.getSelection(TreeViewer.java:255) at org.eclipse.jface.viewers.TreeViewer.setSelection(TreeViewer.java:343) at org.eclipse.jface.viewers.AbstractTreeViewer.setSelectionToWidget(AbstractTreeViewer.java:2477) at org.eclipse.jface.viewers.AbstractTreeViewer.setSelectionToWidget(AbstractTreeViewer.java:2900) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1399) at org.eclipse.jface.viewers.TreeViewer.preservingSelection(TreeViewer.java:402) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1353) at org.eclipse.jface.viewers.StructuredViewer.refresh(StructuredViewer.java:1455) at org.eclipse.jface.viewers.ColumnViewer.refresh(ColumnViewer.java:537) at org.eclipse.jface.viewers.StructuredViewer.refresh(StructuredViewer.java:1414) at net.sourceforge.sqlexplorer.connections.ConnectionsView$5.run(Unknown Source) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 22 more3
15TDQ-856connection analysis with mysql, view keys or indexes will get a NPEcreate a connection analysis with mysql run this analysis and right click on a table, select "view keys" or "view indexes" will get this stack :: java.lang.NullPointerException at org.talend.dataprofiler.core.model.SqlExplorerBridge.findSqlExplorerTableNode(Unknown Source) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractFilterMetadataPage$5.widgetSelected(Unknown Source) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:228) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1176) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3493) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3112) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2405) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2369) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2221) at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:500) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:493) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.datacleansing.core.ui.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:194) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:368) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:559) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:514) at org.eclipse.equinox.launcher.Main.run(Main.java:1311)3
16TDQ-2217jvm terminated error when -Xmx2048m or -Xmx1024mWhen starting TOP with -Xmx2048m or -Xmx1024m setting in TalendOpenProfiler-macosx-carbon.ini in TalendOpenProfiler-macosx-carbon.app package TOP terminates on startup with an error message "jvm terminated" (screendump of error message attached) -Xmx512m is the largest value that allows TOP to start.2
17TDQ-2391When there are more than 2000 tables within an entity, can't execute analsysis on those tablesThis example comes from DB2, but the customer has 2464 tables in some of their subsystems within the database, it is impossible to profile these because the number of tables exceeds the 2000 table limit. Obviously this is major problem as their system legitimately has more than this limit. Is there a way we can either make this limitation configurable or that we can eliminate it all together?13
18TDQ-903Missing field(s) in generated PDF reportWhen generating PDF reports for relation check (column set comparison - template basic match) Talend do not print out analysis name (only name of report is displayed in top of report), which makes it hard to understand which analysis one is looking at. Secondly, for all types of reports, we are missing fields for "Purpose" and "Description". This makes it even harder to read the report since we miss explanatory fields. It would be a great idea to add these to the report templates by default so that all charts and numeric information is backed up by the free text fields.5
19TDQ-1980get changes in "database compare" editorWhen I click on the "copy all non-conflicting changes" button in the database compare editor, I get the following exception and the database is not retrieved in the DQ repository view.3
20TDQ-962Add a confirmation in the preference when we change the databaseIn the preference page, when the user changes the reporting database and click on "apply" or "ok", if the database version is correct and there is nothing particular to do, nothing tells the user that it's ok. Please add a pop-up with the following text (to be externalized): "Connection successful and Datamart well configured"5
21TDQ-1875Feature Request: allow disabling Rules in Analysis, but keep them in the listDear team, It would be nice to have a feature that would allow the user to disable a certain rules/indicator. I envision a operation next to the 'remove' icon in the analysis Settings window where the user can enable/disable the selected rule. That would help in running one particular rule (out of several rules) just for testing or investigation. Thanks.20
22TDQ-2104Support Vertica databaseAdd Vertica database support in TOP. Define the database language for Vertical (Or make it possible to allow users configure the customized database?)20
23TDQ-1230Add a column with an information message when a pattern isn't validated in tMultiPatternCheckIt could be useful to set an extra column (optional) in tMultiPatternCheck to provide functional messages when a pattern isn't validated. For the moment, when a line is rejected, we don't have further information about which pattern has invalidated the row. With such an option, it would enable users to better qualify their rejects, by enriching the reject flow with this additional information.1
24TDQ-1254change the connect configuration data, the data under connection will not change automatically.1. create a dbconnection. 2. open the dbconnection editor, click "Edit", in the "Database Connection" dialog, change the "server" to another one which is available, and "finish". Result: 1. we can check in the editor, the connection information have changed. but the database information in the Repository is the original data, it has not refreshed as connecting to a new dbserver. (1)if we reload the dbconnection, the data under the dbconnection will changed, but if the new and the orginal server have a database whose name is similar, the new one will not replace the old one. (2) if we "database compare', it will show the right result: the "distant strecture" is the new server data, and the local is the original data.3
25TDQ-3298respository with joblet ,when switch to talend profiler will display failure.Create one job about tmysqlinput->logrow,then refactor to joblet named mysql,run this job. Then switch to the "Talend profiler",you will see under the db connection ,display the schema ,not the db.see the jpg. Continue to switch to Talend Integration ,throw some errors: java.lang.Exception: the url of connection parameter can not be null at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadViews(Unknown Source) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getViews(Unknown Source) at org.talend.dq.nodes.DBViewFolderRepNode.createRepositoryNodeViewFolderNode(Unknown Source) at org.talend.dq.nodes.DBViewFolderRepNode.getChildren(Unknown Source) at org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.getChildren(Unknown Source) at org.eclipse.ui.model.BaseWorkbenchContentProvider.hasChildren(BaseWorkbenchContentProvider.java:91) at org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.hasChildren(Unknown Source) at org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.hasChildren(SafeDelegateTreeContentProvider.java:110) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.callNormalHasChildren(NavigatorContentServiceContentProvider.java:428) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.access$4(NavigatorContentServiceContentProvider.java:423) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider$3.run(NavigatorContentServiceContentProvider.java:393) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:379) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:420) at org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2082) at org.eclipse.jface.viewers.TreeViewer.isExpandable(TreeViewer.java:588) at org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2112) at org.eclipse.jface.viewers.AbstractTreeViewer.updatePlus(AbstractTreeViewer.java:2794) at org.eclipse.jface.viewers.TreeViewer.updatePlus(TreeViewer.java:852) at org.eclipse.jface.viewers.AbstractTreeViewer.createTreeItem(AbstractTreeViewer.java:830) at org.eclipse.jface.viewers.AbstractTreeViewer$1.run(AbstractTreeViewer.java:804) at org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) at org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:778) at org.eclipse.jface.viewers.TreeViewer.createChildren(TreeViewer.java:644) at org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:749) at org.eclipse.jface.viewers.AbstractTreeViewer.handleTreeExpand(AbstractTreeViewer.java:1444) at org.eclipse.jface.viewers.TreeViewer.handleTreeExpand(TreeViewer.java:952) at org.eclipse.jface.viewers.AbstractTreeViewer$4.treeExpanded(AbstractTreeViewer.java:1455) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:132) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Tree.gtk_test_expand_row(Tree.java:2105) at org.eclipse.swt.widgets.Widget.windowProc(Widget.java:1775) at org.eclipse.swt.widgets.Display.windowProc(Display.java:4378) at org.eclipse.swt.internal.gtk.OS._gtk_main_do_event(Native Method) at org.eclipse.swt.internal.gtk.OS.gtk_main_do_event(OS.java:8163) at org.eclipse.swt.widgets.Display.eventProc(Display.java:1239) at org.eclipse.swt.internal.gtk.OS._g_main_context_iteration(Native Method) at org.eclipse.swt.internal.gtk.OS.g_main_context_iteration(OS.java:2224) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3169) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.datacleansing.core.ui.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407)3
26TDQ-1340sort regex pattern tXXXInvalidRow/ValidRowwhen you choose regex pattern , list value not sorted8
27TDQ-1359OutOfMemoryError in tMatchGroupSee related discussion topic:1489113
28TDQ-1556Import connections from CSV on TDQ product can't retrieve tableImport connections from CSV on TDQ product can't retrieve table,but TIS can works.8
29TDQ-1576tFirstnameMatch returns no firstname when several matches existThe component returns a "standard" firstname when only one firstname has matched. It's very inconvenient to use when the country and gender information do not exist because there will always be several matches.3
30TDQ-1584tGenKey block profiler does not work with tMDMInputtGenKey block profiler does not work with tMDMInput13
31TDQ-3227Add the ability to lookup for dependencies for a given object in the repository - Repository objects cross-referencesIt could be really nice to have the ability to find dependencies for a given object in the TDQ repository, just like we can already do in the DI Studio. For instance, I'd like to be able to answer the question "Give me the list of the analysis that use this rule", "Give me the list of reports that use this analysis", and so on... Adding a "find dependencies" in the contextual menu, when right-clicking on an element of the repository could be useful. 13
32TDQ-3228Add an "export items" item in the contextual menu of the repositoryAs a DI user, I would expect to have the same behaviour between TIS and TDQ. For instance, I'd like to have an "export items" item in the contextual menu of the repository, to backup my TDQ repo. Unfortunately, this item doesn't exist, and I have to find the related icon in the upper toolbar. Not so user-friendly, and most of the DI users don't find this icon, as they're used to right-click > export items. Can you please unify the user-experience, and add the "export items" directly in the contextual menu of the DQ Repository ? This would help DI users that switch to TDQ to find the same behaviour in the Data Profiler perspective.5
33TDQ-3249Indicators and indicators category should be internationalizedThe text appearing in the column Indicator selection window must be internationalized. In particular Strings in IndicatorEnum should be externalized. 8
34TDQ-3322List all contexts in the Detail viewWhen the focus is on an analysis editor, the Detail view shows the contexts used by the analysis connection (if any). When the focus is on a report editor, the Detail view shows the contexts used by all the analyses that compose the report. 13
35TDQ-3330cannot find the synonym in the index when typing the key word(like as "was")It can't find the synonym in the index when I type the key word(just like "was" , "is","are"). But when I add the "*" at the end(like as "was*"), it can match. My component is tsynonymSearch My Studio is Talend MDM Studio(MPX 4.2.2)1
36TDQ-3389Enhance the connection pool when executing the analysisThe connection pool instance will be created each for an analysis currently. Make the connection pool be shared among all analyses.40
37TDQ-3470can not get the Job correctly by the drill down item for the pattern matching item in the result page 1. create a column analysis, add pattern "Email Address" pattern which is under Libraries->Patterns->Regex->internet. 2. run the anlaysis, in the result page, right click the pattern in the Pattern_Matching table, select "Generate Job", on the pop-up menu select "generate an ETL job to get only valid rows", 3. can get an job, but the pop-up dialog won't disappear, get error the same issue for columnset analysis, please make sure all the similar function work well.5
38TDQ-3490Amend UDI definition to allow drill-down into result sets.Per suggestion in the thread http://talendforge.org/forum/viewtopic.php?id=17584. Enable drill-downs for UDIs by amending the information captured with the "Edit expression" dialog as follows. Tweak the UDI "Indicator Definition" window along the lines of: 1) Move "Indicator Category" prior to the "Indicator Definition". The Indicator Category defines the columns expected in the result set. 2.1) Within the "Edit Expression" window, extra input fields should be available, one for each column expected per the "Indicator Category". 2.2) Each extra field would then contain the expression to be used for the given column 2.3) The existing expression field would then be used for just the SQL required to obtain the result set. 2.4) Probably need to have a separate (though optional) input field for a "GROUP BY" clause, which would be applied as a suffix to 2.3) 3) The current Open Profiler functionality would be achieved by it building the necessary SQL from the constituent elements in the window. It would need to wrap an outermost "SELECT" and "FROM" around the expression provided within 2.2) and use the "group by" clause field from 2.4). 4) The "view rows" capability would then be able to use the logic within 2.3) to retrieve the underlying data. Of course, it's is always simpler to conceptualise a solution than it is to code it! 3
39TDQ-3605uncheck the selected columns can not saved1. create a column analysis, selected some columns,save 2 reopen the analysis, the columns are still there. try to uncheck the columns in "colulmn selection" dialog(both try to click the table folder or the each colulmn one by one), click "ok"close the dialog. 3. check the analysis editor, the colulmns are still there(checked status). save and reopen, columns are still there 4. the same issue for content compare analysis. shoule make sure for column/columnset/contentCompare/Norminal correlation/Numerical correlation/time correlation/function dependency analysis work well for, both check and uncheck function work well in the column selection dialog, and work well for delete selected columns in the column editor by delete button(especially for deleting more than one column)3
40TDQ-3606can't match the right data when having the same or lower score of searching(tsynonymSearch, Lucene)My data synonym can be matched correctly when I want to find his data standard in the component "tsynonymSearch". In fact, the data input is the same as the data synonym. But ,I have a lower score than others which have less synonym data. My studio is Talend MDM Studio (TIS TDQ Enterprise MPx)(4.2.2r63143) My system is Ubuntu 10.10 13
41TDQ-3608Set A threshold to filter the match results in the tSynonymSearch component with low score can't match the right data when the data input includes the words like as "la","de",.... My data synonym(input) can't be matched correctly when the data input with the words like as "la ", "de",... My studio is TIS TDQ Enterprise MPx 4.2.2 r63143 My system is ubuntu 10.101
42TDQ-3617generate job to get patterns, run the generated job with errorright click on patterns --> regex in repository, select "Generate jobs" --> "Get patterns" option then will generate a job, run this job will get this error Exception in component tFindRegexlibExpressions_1 org.dom4j.DocumentException: Error on line 59 of document : The element type "br" must be terminated by the matching end-tag "</br>". Nested exception: The element type "br" must be terminated by the matching end-tag "</br>". org.dom4j.io.SAXReader.read(SAXReader.java:482) org.dom4j.io.SAXReader.read(SAXReader.java:343) a.getwebpatterns_1316576908987_0_1.GetWebPatterns_1316576908987.tFindRegexlibExpressions_1Process(GetWebPatterns_1316576908987.java:1189) 8
43TDQ-3625create a new report twice, the second time can not be successfulwith the same analysis, to create a a new report twice, after the second time, you can not see the report successfully note: should make both the "replace" and "not replace" OK5
44TDQ-3642parser rule import, export issues.tried to export parser rule item I didn't find "export ..." on rule item, but I can find a menu "export for talend exchange" on their parent node so I click on that menu, and it will generate a .csv file and a .zip file zip is empty and the csv file is only contains title column, doesn't contain rule item in it then I tried import function I import the exported empty .csv file, I think the correct result is pop up a dialog to tell user that, "no valid rules in that file .." and do nothing but the result now is, it will "import" the rule with empty label, empty content in the repository. another is about Talend Exchange I can get one rule under exchange -- "test parser rule" I tried to import this into local after import operation is finished, I can't get this rule in my local repository (even not in workspace, I checked my disk) and it will pop a dialog shows that 4 items import in the list, 1 is imported successfully, 3 are "already exists " error message seems I import once, it will do 4 times and I think if the item is exists, it shouldn't be an error message, a warning message is better I think.2
45TDQ-3676Ability to define the order of Analysis in a reportThere does not appear to be a mechanism for ordering the Anaylsis used in a DQ report. I thought it was ordered alpha-numerically, but I have just seen an example where it goes 01-<analysis_name>, 04-analysis_name, 02-analysis_name, 03-analysis_name. A mechanism to allow user defined ordering of the analysis on a report would be very useful.8
46TDQ-3684Register via Proxy doesn't workDear team, Registering from within a corporate network that uses Proxies for Internet connection does not work. I put all proxy information into the network settings, but it always does not recognize me and TOP asked to provide all user information for registration. The function also did not work in 4.2.2. I usually go around the issue by using my home network connection. Going back after a failed attempt, the network settings do not include any information (all what I entered before is gone).3
47TDQ-3688Profile freezes and never comes backWhile creating DB connection in TDQ profiler, if "export as context" is clicked and try to save talend hangs and doesn't comeback. I think this might be due to the reason that context concept is not for DQ but if that is the case then it would be better to not have that option of "export as context" on DQ side. 3
48TDQ-3691Configuration wizard failed after tFixedFlowInputThe data column is empty in the configuration wizard dialog of tMatchGroup after tFixedFlowInput3
49TDQ-3692Order or results of Column analysis using UDI appears randomI have a UDI Freqency Analsyis which I use in a DQ Analysis. When I run the analysis in teh Studio, the results are shown in decending order or frequency. However, the same Analysis used in a report shows the results in random order. Please see attached examples5
50TDQ-3769synonym index tree item doesn't order itemsin "synonym index" view open one index file, the items of the tree is not ordered5
51TDQ-3811Each time run "exportitems" use commandline ,many unexpect info popupEach time run exportitems use commandline ,many unexpect info popup !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,688 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\address\Postal_code_or_Pin_code_of_India_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\internet\Website_URL_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\date\French_date_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\phone\FR_Phone_Number_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\SQL\internet\Email_Yahoo_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Indicators\System Indicators\Correlation\Multiple_Column_Frequency_Table_0.1.definition !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\number\Integer_values_0.1.pattern ............................ 5
52TDQ-3840for column set analysis only the last run one can show the content.1. create 3 report(a1,a2,a3) which just contains column set analysis. 2. generate report file a1,a2,a3 3. check the function of "Reporting->Table analysis->column set analysis" result: can retrieve a1, a2, a3 correct. try to check the content of the three file. only a3 which the last generate one show the content. 4. run report a1 in studio again, then check in dqportal, only a1 show content. should make it work well for mysql and oracle datamart on branch 4.2 and trunk.8
53TDQ-3903A not exists table is shown to user in portal of overview analysis reportstart dq portal run a overview analysis report In result table list there is a not real exists table -- "TOTAL" take a look at screen shot ..2
54TDQ-3906output of tMatchGroupHadoop is optionalCurrently, each tMatchGroupHadoop component will output the match result of the current pass. In effect, the output won't be necessary if its immediate follow up component is also a tMatchGroupHadoop. Add a checkbox in the properties panel of tMatchGroupHadoop called "Keep data in hadoop". When unchecked, the component works as it is currently working; that is: data are retrieved from hadoop hdfs and output in the job flow. When checked, the component leaves the data on hadoop hdfs. By default, the checkbox is unchecked. 13
55TDQ-3917Dq portal template design improvementsLogin as tdq_user: Choose menu : Reporting->Column analysis->Simple statistics , we could see many kinds of reports (this 'kinds' means the classification of reports in dq portal), such as Frequency statistics/Pattern matching. Similarly, we could find Frequency report when pass 'Frequency statistics' menu (Pattern matching report also like this). I think the Frequency report should be the same no matter with which menu we passed(Simple statistics menu or Frequency statistics menu), so 'Simple statistics' report and 'Frequency statistics' report and 'Pattern matching' report should be the same template. And we could see the initial templates of report Simple statistics/Frequency statistics/Pattern matching , they use the same template (p01_column_basic.jrxml) , but now the templates are different , I think it's wrong. In this case, we need to fix one by one, very time consuming. And I think it's not the original designers ideas. So I think, if we can use the same template report, try to use the same. 8
56TDQ-3978Ctrl+S does not save the pattern editorIn Talend-Studio-r72167-V5.0.0NB, the shortcut Ctrl+S does not save the Pattern editor. I can only save with the "save" button. 2
57TDQ-3995Check and update standardization jobs in DQ demo project according to the latest changementsNULL3
58TDQ-4018start top on redhat, the welcome page is blank, when create files, the help inform in the wizard in blank.1. start top on redhat os. 2. check the 'welcome page', it is blank 3. try to crate analysis file, the help information is also blank, and sometimes it will pop up a new file to show the help information. refer to pic.3
59TDQ-4036Review all the existing cheat sheets and list here the missing onesThere is not cheat sheet to create a file connection for instance. Please, list all the missing cheat sheets here (those should correspond to the creation menus of the DQ repository view). If you think about other cheat sheets, add them here too. We'll decide later which one will be implemented. 8
60TDQ-4037Improve "Details view"See attached screen capture.13
61TDQ-4039when colse the configuration wizard just save the origianl tab value, but not the current one1. create a job with tMatchGroup component , can run the job correctly. 2. get the configuration wizard of the component. 3. click the 'duplicate rule ' icon, will get a new rule named 'Match Rule1' whose value is same as the 'Component' one. 4. select 'Match Rule1' tab, click 'refresh' to get the result, but not same with 'Component' (issue 1) 5. do some change in the 'Match Rule1' tab, then 'refresh' get result, click 'ok' to close the wizard. 6. check the property of tMatchGroup, it save the value of 'Component', but not the current one when you close the dialog(issue 2). 8
62TDQ-4054DQ Repository view UI improvementsThe icons are not fully visible on Linux. The scrollbar should appear only when needed.5
63TDQ-4056Wrong label for summary statisticsThe summary statistics table in the result tab of the column analysis should not display "count" but "value" instead.1
64TDQ-4067blank pattern test, make a different result about "Tab" between DB and javapattern test result of "blank text" about "Tab" character, if choose DB connections to test, got non-match but if it is java, will got a match shall we make the results are unanimous ? (both "match" or "non-match")5
65TDQ-4108Unable to drill down on Teradata databasesThis issue is similar to one raised on old bug tracker with id 0023101 . Unable to drilldown on Teradata database in DQ Repository . I'm able to drill down(and view the database structure) in Data Explorer view. The drill down is only working in TOP 4.1.3 but neither in TOP 4.2.3 nor in TOS DQ 5.0.03
66TDQ-4116Welcome screen is different for local and remote connectionsThe Talend Data Quality exposes different Welcome screens for local and remote connections. The screen shots are attached. This task has very low priority, it doesn't impact on anything. I've created this task because it might be related to this task http://jira.talendforge.org/browse/TDQ-4087.5
67TDQ-4117TOP 4.2.3 - DB Connection is referencing wrong columnsI have a DB connection to a MYSQL DB that has multiple catalogs and multiple tables. When I look at the columns for a specific table (cif.customer) in TOP, the columns do not match what is in MYSQL Workbench. If I do a column reload, the columns do match what's in MYSQL Workbench. If I try to do a Columnset Column Analysis and point to the cif.customer table, the columns are not correct. 5
68TDQ-4133Permgen space exception in data explorerI got a Permgen space exception after running a query to see the invalid rows of a DQ rule applied in a table analysis. (See the dqrule in the log) 27592102 [main] INFO org.talend.core.model.metadata.builder.util.MetadataConnectionUtils - Database Product Name: MySQL 27592138 [main] INFO org.talend.core.model.metadata.builder.util.MetadataConnectionUtils - Database Product Version: 5.1.36-log 27726641 [Thread-160] INFO org.talend.dq.analysis.AnalysisExecutor - Connection tojdbc:mysql://localhost:3306/tbi?noDatetimeStringSync=true 27727095 [Thread-160] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Name:MySQL 27727095 [Thread-160] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Version:5.1.36-log 27728284 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Computing indicator: Row Count 27728303 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Executing query: SELECT COUNT(*) FROM `tbi`.`customer` 27728424 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Computing indicator: rule 27728425 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Executing query: SELECT COUNT(*) FROM `tbi`.`customer` WHERE (email like '%@company%' or email like '%@%.com') 27728451 [Worker-128] INFO org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction - "Analysis "rule" execution code: OK. Duration: 1.79 s. 27737110 [main] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Name:MySQL 27737123 [main] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Version:5.1.36-log Error while informing user about event loop exception: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632) at java.lang.ClassLoader.defineClass(ClassLoader.java:616) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.defineClass(DefaultClassLoader.java:188) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.defineClass(ClasspathManager.java:580) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findClassImpl(ClasspathManager.java:550) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClassImpl(ClasspathManager.java:481) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass_LockClassLoader(ClasspathManager.java:469) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass(ClasspathManager.java:449) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.findLocalClass(DefaultClassLoader.java:216) at org.eclipse.osgi.internal.loader.BundleLoader.findLocalClass(BundleLoader.java:393) at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:469) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:422) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:410) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(DefaultClassLoader.java:107) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) at net.sourceforge.squirrel_sql.fw.sql.SQLConnection.<init>(SQLConnection.java:80) at net.sourceforge.sqlexplorer.dbproduct.SQLConnection.<init>(SQLConnection.java:49) at net.sourceforge.sqlexplorer.dbproduct.ManagedDriver.getConnection(ManagedDriver.java:212) at net.sourceforge.sqlexplorer.dbproduct.User.createNewConnection(User.java:410) at net.sourceforge.sqlexplorer.dbproduct.User.getConnection(User.java:290) at net.sourceforge.sqlexplorer.dbproduct.Session.grabConnection(Session.java:131) at net.sourceforge.sqlexplorer.dbproduct.ConnectionJob.run(ConnectionJob.java:116) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Dialog open exception: java.lang.OutOfMemoryError: PermGen space 13
69TDQ-4159can't show the column filter and table filter Text when table include many columnsif a table include many columns, when open the "Select Column Dialog", can't show the column filter and table filter Text correctlly, see the screenshot a.jpg, the right show should be b.jpg5
70TDQ-4179user defined indicator cannot be duplicatedwhile I tried to duplicate a user defined indicator it pops me a dialog says: this '..' of indicator's type could not be duplicated5
71TDQ-4183Enable cascade rules in tRuleSurvivorship componentpermit users to resolve the survivors by several steps.13
72TDQ-4189import items overwrite function about system indicatorIn 4.2.x workspace, I got a column analysis with some system indicators these indicators only have one DB definition (for eg: only mysql) .. In 5.0.x workspace, I got another column analysis with the same indicators as in 4.2.x these indicators also have only one DB definition (for eg: only postgresql) import 4.2.x workspace into 5.0.x whatever I overwrite or not about these used indicators there is always one side can't work well ... overwrite: the analysis in 5.0.x can't work not: the analysis in 4.2.x can't work28
73TDQ-4193Create TUJ for TDQ-3273Create a TUJ to test the changes done in TDQ-3273 See with Sizhao Liu if you need more information. 2
74TDQ-4234Store the report execution timeWhen we run a report several times and the analysis is not refreshed, then we loose the information about the time when the report has been executed. This results in some bugs in the generated reports (such as duplicated rows in overview analysis) TODO: 1. Store the metadata results in the report object. 2. Store these information in the fact tables of the datamart. 3. create a database migration task to add the columns. items 2 and 3 will be worked in related issues. 5
75TDQ-4268According to the suggestions of tech meeting TDQ-4194, clean up the un-disposed system resources.- Use tools mentioned in the meeting (sleak etc.) to find the resources in DQ projects that are not disposed appropriately before. - Dispose them in the right way. 8
76TDQ-4313edit the system indicator's name may lead to some problems when do migration.in our product, we can change the name of the system indicator, but this will lead to the same UUID after migration to a new workspace.3
77TDQ-4327Error happens when displaying the help contents in DQ studioOpen the help window in DQ studio, the contents of left panel was empty. Click the "Index" tab below, error occurs.2
78TDQ-4329Need to fix / review JUnitsHere's the list of failed JUnits actually on trunk / branch 5.0 related to DQ: org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetTypeSystem org.talend.cwm.db.connection.DBConnectTest.testRetrieveColumn org.talend.cwm.management.api.DbmsLanguageTest.testDbmsLanguage org.talend.cwm.management.api.DbmsLanguageTest.testDbmsLanguageString org.talend.cwm.management.api.DbmsLanguageTest.testDbmsLanguageStringIntInt org.talend.cwm.management.api.DbmsLanguageTest.testAnd org.talend.cwm.management.api.DbmsLanguageTest.testOr org.talend.cwm.management.api.DbmsLanguageTest.testBetween org.talend.cwm.management.api.DbmsLanguageTest.testNotEqual org.talend.cwm.management.api.DbmsLanguageTest.testEos org.talend.cwm.management.api.DbmsLanguageTest.testGetDbmsName org.talend.cwm.management.api.DbmsLanguageTest.testGetDefaultLanguage org.talend.cwm.management.api.DbmsLanguageTest.testToQualifiedName org.talend.cwm.management.api.DbmsLanguageTest.testGetZqlParser org.talend.cwm.management.api.DqRepositoryViewServiceTest.testGetTables org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetSchemas org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetTablesWithColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetTablesWithoutColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetViewsWithColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetDataType org.talend.dq.analysis.explore.PatternExplorerTest.testGetInvalidRowsStatement org.talend.dq.analysis.explore.PatternExplorerTest.testGetValidRowsStatement org.talend.dq.sql.converters.CwmZExpressionTest.testGetOperator org.talend.dq.sql.converters.CwmZExpressionTest.testSetOperandsColumnColumn org.talend.dq.sql.converters.CwmZExpressionTest.testGetColumn1 org.talend.dq.sql.converters.CwmZExpressionTest.testGetColumn2 org.talend.dq.sql.converters.CwmZExpressionTest.testGenerateZExpression org.talend.dq.sql.converters.CwmZExpressionTest.testGenerateExpressions org.talend.dataquality.matching.date.pattern.DatePatternRetrieverTest.testHandle org.talend.dataquality.standardization.index.test.IndexBuilderTest.testGetIndex org.talend.dataquality.standardization.index.test.IndexBuilderTest.testInitializeIndex org.talend.dataquality.standardization.index.SynonymIndexBuilderTest.deleteIndexFromFS org.talend.dataquality.standardization.main.test.BooleanQueryTest.testAnd org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testCreateIndex org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testGetSearchResultStringStringMapOfStringStringBoolean org.talend.dataquality.standardization.query.test.FirstNameStandardizeTest.testStandardizeStringString 40
79TDQ-4351fix problems with HandLuceneImplTest and FirstNameStandardizeTestThese tests are running as Junit tests in my environment. Do we need to run them as Plugin Junit tests?2
80TDQ-4377Messy Layout of Analysis SummaryThe layout of the summary data could do with an overhaul. Title and Data text run together with spacing.2
81TDQ-4378Check indicators' UUIDsThe attached document describes the UUIDs as they were in April 2009. Check whether they have changed. 8
82TDQ-4393The second time logon DQ demo project , error messageLaunch studio and import DQ demo project, the first time is ok switch project logon demo project again, get error at error log list(logon with this license:MDM_TDQ_EE_MPX_5users): org.eclipse.core.runtime.AssertionFailedException: null argument: at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:85) at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:73) at org.eclipse.core.internal.events.ResourceChangeListenerList.remove(ResourceChangeListenerList.java:146) at org.eclipse.core.internal.events.NotificationManager.removeListener(NotificationManager.java:305) at org.eclipse.core.internal.resources.Workspace.removeResourceChangeListener(Workspace.java:1934) at org.eclipse.wst.server.core.internal.ResourceManager.shutdownImpl(ResourceManager.java:367) at org.eclipse.wst.server.core.internal.ResourceManager.shutdown(ResourceManager.java:313) at org.eclipse.wst.server.core.internal.ServerPlugin.stop(ServerPlugin.java:360) at org.eclipse.osgi.framework.internal.core.BundleContextImpl$2.run(BundleContextImpl.java:843) at java.security.AccessController.doPrivileged(Native Method) at org.eclipse.osgi.framework.internal.core.BundleContextImpl.stop(BundleContextImpl.java:836) at org.eclipse.osgi.framework.internal.core.BundleHost.stopWorker(BundleHost.java:501) at org.eclipse.osgi.framework.internal.core.AbstractBundle.suspend(AbstractBundle.java:550) at org.eclipse.osgi.framework.internal.core.Framework.suspendBundle(Framework.java:1097) at org.eclipse.osgi.framework.internal.core.StartLevelManager.decFWSL(StartLevelManager.java:597) at org.eclipse.osgi.framework.internal.core.StartLevelManager.doSetStartLevel(StartLevelManager.java:257) at org.eclipse.osgi.framework.internal.core.StartLevelManager.shutdown(StartLevelManager.java:215) at org.eclipse.osgi.framework.internal.core.InternalSystemBundle.suspend(InternalSystemBundle.java:266) at org.eclipse.osgi.framework.internal.core.Framework.shutdown(Framework.java:690) at org.eclipse.osgi.framework.internal.core.Framework.close(Framework.java:588) at org.eclipse.core.runtime.adaptor.EclipseStarter.shutdown(EclipseStarter.java:415) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:198) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383)8
83TDQ-4433different migrate ways lead to defferent result for generating report migrate from 4.1.3 which contains overview analysis or column set analysisway 1 (1). migrate report from 413 by logon window, select the "root directory" way choose the project want to migrate. (2). generate the report file which contains overview analysis or column set analysis, successfully. way 2. (1). migrate report from 413 by import button, select the "root directory" way choose the project want to migrate, and checked the system indicators(it is automatically checked). (2). generate the report file which contains overview analysis or column set analysis, successfully. way 3. (1). migrate report from 413 by import button, select the "root directory" way choose the project want to migrate, and un-checked the system indicators(it is automatically checked,should uncheck them manually). (2). generate the report file which contains overview analysis or column set analysis, failed. get errors way4. (1). export the report file in 413 as a zip file, doesn't export the indicators file. (2). import the exported file in step 1 (3). generate the report file, get errors. 2012-01-06 18:10:33,468 WARN org.talend.dq.persistence.handlertype.AbstractPersistenceHandler - Can't find the category of indicator 'null' 13
84TDQ-4437correct logic probleme in TUJ named Feature_TDQ_3568_tGoogleAddressRowNULL1
85TDQ-4453export mdm connection don't include the .xsd folderexport mdm connection don't include the .xsd folder8
86TDQ-4513import the file have just exported failed.1. create some files by tdq, export them. 2. try to import the items again, failed , refer to the pic. no errors. have attached the file have exported.8
87TDQ-4522switch page number in result page will cause studio crash for large data.1. I have imported some files from 413(43 analysis, 22 report, 10 dbconnecton) 2. create an analysis which contains 100 columns and select all indicators for the analysis. 3. run the analysis and then switch to result page, after change page number , it seems when change 9 times, error will show. studio will crash. I don't know why can not reproduce this on top(no files imported from 413)8
88TDQ-4523Add "Table analysis" menu on the views in the overview analysis editorThere is currently a menu to do a table analysis on analyzed tables. Add the same menu on the analyzed views. 8
89TDQ-4526Messed up DQ repository viewI did several simple analyses and report on columns, tables, views, connections, catalogs... The DQ repository view ended up to a big mess. See attached screen capture. After I clicked on Refresh, it seems that everything returned to the expected layout. 13
90TDQ-4527Create a project to check the integrity of the DQ datamartWe need a DQ project that analyzes the DQ datamart and checks the quality of the content of the DQ datamart. This project existed in version 3.2.2. I have a 150Mo zip file. If we can't import it, then we need to create it from scratch. We'll have to maintain this project through all the future releases. In my opinion, this project should be used and maintained by the QA team. 20
91TDQ-4534after Import Patterns, the DQ Repository view do not refreshed automaticallyafter Import Patterns, the DQ Repository view do not refreshed, so could not find the import pattern, the user have to refresh himself3
92TDQ-4535columns in analysis gone after reloading the connection with changing filter in the connection wizardsometimes reolad connection don't should lost information on the analysis.5
93TDQ-4539Patterns/indicators have the same label but in different folder can't be added into analysisIf the pattern or indicator has the same label, but they don't in the same folder cannot be added into analysis branch 5.0 and trunk, can't create the item that have the same label but the warning information seems not right please check that5
94TDQ-4544Do dispose for tmatchgroup configure wizardToo many leaks on closing wizard dialog.8
95TDQ-4545Properly handle dependencies between report and jrxml filesProperly handle dependencies between report and jrxml files13
96TDQ-4550Inform about the database versionThe information dialog must display the datamart version. The message should read: "Your DQ datamart version is old: " + <version from DB> + ". Do you want to upgrade it?"3
97TDQ-4553Rule Node could not Link to DQ RuleEditorThe reason is not returned the link helper descriptors for a given selection and content.5
98TDQ-4555Remove org.deved.antlride.ui from svnRemove this plugin from source and find a way to patch it. note that only the plugin export package: org.deved.antlride.internal.ui.editor have been made public in order to reuse the editor in the parser Rule Test Editor.3
99TDQ-4558Connection in Report editorThe connection used by the report editor should be configurable as "built-in" or "repository". Add a combo list with these two values "built-in" and "repository". When the "built-in" mode is selected, the connection fields are editable (just like now). When the "repository" mode is selected, an existing connection in the repository can be chosen. - "built-in" mode: the button on the right side allows the user to export his connection to the repository. - "repository" mode: the button on the right side allows the user to select an existing connection. It opens a pop-up to select a connection with type "MySQL" or "Oracle" only. When this mode is chosen, the connection fields are read-only. * Note: When the repository mode is used, it's possible for the user to have a contextualized connection. Make sure that everything works when there is a context, and the report is exported as script or job. 13
100TDQ-4559Add "switch context" menu on file connectionThere is no menu to switch the context on a file connection. Add this contextual menu on file connections (just like for the database connections). (Note: MDM connections don't handle contexts. So we won't do anything for these connections)5
101TDQ-4570Use the tMatchGroup configuration wizard also for the tMatchGroupHadoopUse the same configuration wizard. 13
102TDQ-4584analysis with file connection run failedcolumn/columnset analysis run with file connection failed will throw this error:: java.lang.NullPointerException at java.util.Hashtable.put(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.checkConnIsUseful(RunAnalysisAction.java:317) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.run(RunAnalysisAction.java:217) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:452) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 5
103TDQ-4594Change the link to the bugtracker in the bookmark listClick on Help>Bookmarks. The link to Talend bugtracker must be changed to Jira: http://jira.talendforge.org 1
104TDQ-4599truncated string in pattern test viewThe text is truncated in pattern test view. See screenshot. The text field should adapt to the input text (don't use a fixed size)2
105TDQ-4601Remove the pattern category from Talend ExchangeRemove the Talend Exchange "Pattern" category in the studio. Remove the category on the Talend Exchange website.2
106TDQ-4602Export babili translations into trunk of SVNNULL2
107TDQ-4603try to import a file under Libraries->Exchange->Regex for the second time, will get errors.1. logon a remote project 2. import the file under Libraries->Exchange->Regex. 3. after imported, check Libraries->Patterns->Regex, the file shows, 4. try to import the file which you have just imported again. result : (1) get an inform dialog which show information the file you have imported (2) get error (check it under "Details" tab) 5. try to imported other file under Libraries->Exchange->Regex, will get inform dailog, and errors. note: after import, when click on one node in the DQ repostory view, (for example: TDQ_Libraries/Exchange/Regex/Dutch Phone Number), can get the error dialog13
108TDQ-4604try to import 413 files on logon window "Import existing projects as local"1. on the logon window try to import a 413 project. 2. logon the project, check the analysis all show as "TDQ Analysis" , report show as "TDQ Reports" try to unfold the system indicators folder, can not unfold. 3. try to import the same 413 project, the indicators will be selected automatically, after imported successfully. check the system indicators , all show twice. both logonon window and import button should work well for the migration. 8
109TDQ-4607Rename the file under the "Librarys\Sources Files\", then open it, the display of the editor is incorrect1. unfolder the "Librarys\Sources Files\" 2. rename the file "TEST_TOP", see the DQ Repository view, there is no change 3. then open it, the display of the editor is incorrect note: there is no error in the Error view3
110TDQ-4608Generate user define report when select columnset as report template selector has some error 1.Right click on folder DQ Repository->library->JRXML Template. 2.click "Import Build-in Reports". 3.Create a columnset analysis , 4.Create a report ,set the columnset analysis as analysis , and select .jrxml file b01_column_set_basic or b01_column_set_evolution as template type. you can refer to u_define1.png 4.Run this report.Generate file. It's error. you can refer to the u_define2.png and the error log in the attarch file 5
111TDQ-4609Add the display name of the items in the DQ datamartAdd a new column in all dimension table for the display name. See related issue TDQ-431320
112TDQ-4612Sort data in the output of the tMatchGroupHadoop componentAdd an option to sort the data in the advanced settings of the component (just like the tMachGroup) Sort the data using the hadoop framework. 13
113TDQ-4614Upgrade SpagoBI- Download the SpagoBI which is the latest stable release. - Replace the related libraries and configuration file (backup the configuration before replacement). - Reconfigure the SpagoBI together with DQPortal configuration. - Handle database discrepancy (migration the database). - Launch the application and test the features. - List here the failed features and incompatible features if any.20
114TDQ-4615Prepare DQ Portal migration scriptAs a user of the DQ Portal in previous version, I will want to migrate my DQ portal to the new version in order to keep of of my customizations done in the previous version (reports added, menus, users, etc)13
115TDQ-4616Enable the upgrade from the installerNULL20
116TDQ-4627Incorrect "Java option" tab for the "frequency table" indicatorThis tab should not appear on the "frequency table indicator". It's specific to the pattern frequency table indicator. 2
117TDQ-4628Cannot create a DQ rulegot this NPE when i create a new DQ rule in the DQ Demo project java.lang.NullPointerException org.talend.dq.indicators.definitions.DefinitionHandler.getDefinitionById(DefinitionHandler.java:385) org.talend.dq.indicators.definitions.DefinitionHandler.getDQRuleDefaultIndicatorDefinition(DefinitionHandler.java:368) org.talend.dataprofiler.core.ui.wizard.dqrules.NewDQRulesWizard.getExpression(NewDQRulesWizard.java:105) org.talend.dataprofiler.core.ui.wizard.dqrules.NewDQRulesWizard.createAndSaveCWMFile(NewDQRulesWizard.java:82) org.talend.dataprofiler.core.ui.wizard.AbstractWizard.performFinish(AbstractWizard.java:65) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.dataprofiler.core.ui.action.actions.CreateDQRulesAction.run(CreateDQRulesAction.java:63) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:125) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) 3
118TDQ-4630Cannot save a functional dependency analysisCreate a functional dependency analysis in the DQ demo project. Save. Got this NPE: java.lang.NullPointerException org.talend.dq.indicators.definitions.DefinitionHandler.getDefinitionById(DefinitionHandler.java:385) org.talend.dq.indicators.definitions.DefinitionHandler.getFDRuleDefaultIndicatorDefinition(DefinitionHandler.java:372) org.talend.dataprofiler.core.ui.editor.analysis.ColumnDependencyMasterDetailsPage.saveAnalysis(ColumnDependencyMasterDetailsPage.java:260) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.doSave(AbstractAnalysisMetadataPage.java:153) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.doSave(AnalysisEditor.java:147) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.run(RunAnalysisAction.java:139) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:452) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:125) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) 3
119TDQ-4632[Distinct indicator on column which name contains parentheses] Analysis failed[Distinct indicator on column which name contains parentheses] Analysis failed when column name contains parentheses like "attribut (IRIS)"5
120TDQ-4644when pattern is defined on only a database, "Generate an ETL job to handles rows" function failed.1. create a pattern which definition is only for oracle database. 2. create a column analysis about an oracle dbconnection. 3. add pattern to the analysis, analysis run well. 4. turn to analysis result page, right click the pattern in the result table ->generate job, in the pop up dialog, select "Generate an ETL job to handles rows" can not continue, refer to the pic attached(Generate an ETL job Error.bmp). 3
121TDQ-4645Add "filter" attribute in connection file, provide filter on right click context menu like column filter.- Add a "packageFilter" as a tagged value for connection. - Save the value to this filter the first time connection created. (note that most of database, the parameter "database" can be used as filter) - Provide context menu on connection to be able to add/alter filter just like column filter. - Create migration task to fill in this filter for existing connections from older build.5
122TDQ-4646can not generate the AlterThresholdValidation job successfully.1. crate an analysis, set some thresholds, and some data is out of the range you set. 2. create a report about the analysis, and generated successfully. 3. right click the report generate jobs->Alter threshold violations. the job can generate but get errors, can not run successfully either.8
123TDQ-4654Threshold violation don't appear for phone number indicatorsI've set a threshold on the "possible phone number" indicator. This threshold is violated and the value of the indicator appears in red in the report. That's correct, but the INDICATOR_PERC_OK displays "N/A". It should display "N". See screenshot5
124TDQ-4655tRecordMatching returns all remaining rows in the "non-matches" flowIn the "cif" job, the "matches" flow contains 297 rows. In the "cif_without_match, I removed the "matches" flow. All the 297 rows went to the "non-matches" flow !!1
125TDQ-4665with tBRMS component, "Guvnor Package" links are incorrect if browse POJO class from a snapshot folderWith tBRMS component, we need to browse a jar containing POJO classes from remote guvnor repository, in order to create JiBX binding for the XML output, as a runtime dependancy of the Job. We also need a remote URL to access the remote binary Knowledge Package. The component help us to retrieving this URL based on the webdav structure whe we browsed our POJO file. The problem is that the webdav structure of Guvnor is actually not coherent to the binary package path that we need. If the POJO file is selected from package folder (like trunk), the URL webdav is very near to that of binary package. we only need a concatenation and a small replacement ("/packages/"->"/package/"). But if the POJO file is selected from a snapshot folder (like a release of business rule set), The "Guvnor Package" field will be filled like "/snapshots/org.talend.bank/snap123/LATEST", which should be "/packages/org.talend.bank/snap123" instead. 1
126TDQ-4669change the strategy behaviorAt the moment, if "First" is selected as strategy, and the lookup returns several Matches and several Possibles, the output will contain the first one of Matches, and the first one of Possible Matches. The "Last" and "Best" Strategies have the similar behaviors. These behaviors should be changed according to the objectif of the strategy in real life. A. "First" strategy aims to quickly find out a match who passes the threshould. The output should only contain the first match, or the first possible match in case there is no match. B. "Last" strategy is for special reason, for example, the records are merged from several sources and the last source among them is supposed to contain records with best quality. The behavior of this strategy should be similar to "First". C. "Best" strategy is used to find out the best match, or the best possible match when there is no match, there should be only one output record for a source record. Imagine that we have the following sequences of scores as a result of lookup, for which 0.7 and 0.3 are respectively the threshoulds of match and possible match: A) 0.4 0.6 0.9 1.0 0.8 0.5 0.1 With "First" strategy, the final result should be 0.9 With "Last" strategy, the final result should be 0.8 With "Best" strategy, the final result should be 1.0 remark: if the Matches connection is not activated, it only means the user don't want to know the matches. So even in this case, we should not output anything to the Possible connection. B) 0.4 0.6 0.5 0.1 With "First" strategy, the final result should be 0.4 With "Last" strategy, the final result should be 0.5 With "Best" strategy, the final result should be 0.6 8
127TDQ-4672some system indicators will be unload after run duplicate1.run the duplicate on some analysis 2.then create a new dq rule some system indicators will be unload, then there will throw NPE when create a new DQ Rule the system indicators which be unload are: on branch 5.0 demo project: 1. WeekFrequency 2. Catalog Overview 3. Connection Overview 4. Schema Overview 5. Phone Number Statistics 6. IQR 7. Mean 8. Range 9. Summary Statistics on trunk new project: 1. Catalog Overview 2. Connection Overview 3. Schema Overview 4. Phone Number Statistics 5. Simple Statistics 6. IQR 7. Mean 8. Range 9. Summary Statistics 10. Text Statistics13
128TDQ-4673The link to the installation guide in the Welcome page is deadWhen you launch the TOS for DQ build, the "installation guide" link points to an empty page (see screenshots attached). Note that the "valid" wiki page that explains the installation process can be seen here: http://talendforge.org/wiki/doku.php?id=doc:installation_guide launch the top1
129TDQ-4674 little typo error in the fuctionality of nominal correlation analysisjust found this little bug while using Talend Open Studio for MDM while doing "Nominal Correlation Analysis" from the Profiling perspective... displays "show in fullscreem" instead of "fullscreen" have attached the image showing it... hope you guys fix it :) cheers...2
130TDQ-4675Should default select the used item in Pattern Select Dialog 1.selecet a pattern for column analysis.then save this analysis. 2.reopen the Pattern Select Dialog,that item checkbox is not checked.8
131TDQ-4676Threshold for Pattern Match is not clear.1.set the threshold(make it is out of range) for pattern. 2.run this column analysis. 3.the value color of column '#Match' '%Match' in result page is red. 4.the value color of column 'Not Match' in the realted report is red. I don't know that it is aviable for Match or Not Match.3
132TDQ-4688it is so slow when duplicate a DQRule in the demo projectjudge the same name when duplicate a DQRule will call the method "List<ModelElement> org.talend.dq.helper.resourcehelper.ResourceFileMap.getAll()" to get all type of ModelElements, it should be only get the DQRules3
133TDQ-4691"view row " failed for MDM analysis 1. create a mdm connection. 2. create a column analysis about this connection. 3. run analysis with java mode, try to view row , failed. for the columns which "veiw row" failed are not for all, please refer to the pic.5
134TDQ-4705can not re-open the project which just contains files migrate from 4.2.3.1. open a new project and open. 2. import files by "import button" from 4.2.3, select "root directory" in the import dialog. 3. import finished, try to reopen the project. 4. if try to do migration by logon window, can not open the project on first time. Result: can not reopen it successfully. I have two 423 project, one can do this reopen successfully, but the another can not. error log added under Details tab.5
135TDQ-5074jdbc connection used in job,export the jdbc connection as context,click finish,the update choose no,there are errorsNULL13
136TDQ-4706import lower version project on the logon window, the "Parser" Folder lost.1. open studio. 2. on the logon window select the "import existing project(s) as local" 3. select a lower version project(lower than 5.0--no parser folder) 4. open the new import project,check the repository. the the "Parser" Folder lost under "Rules".5
137TDQ-4710view invalid row incorrect on pattern matching indicatorThe query generated by the "view invalid rows" or "view valid rows" menus is not correct when it's from the pattern matching indicator in a column analysis. Indicator query: SELECT COUNT(CASE WHEN `lname` REGEXP BINARY '^[A-Z]*$' THEN 1 END), COUNT(*) FROM `tbi`.`customer` Query generated to view valid rows: SELECT `lname` FROM `tbi`.`customer` WHERE `lname` REGEXP '^[A-Z]*$' The "binary" keyword is missing. note: analyzed database is mysql 8
138TDQ-4711Pattern on Talend Exchange called "Email Address (with list of top-level domains)" does not work with mysqlImport this pattern and use it on tbi.customer.email 100% of email are invalid. The imported pattern contains \ \ \ \. It should be \ \. What is the reason? Is the pattern on Exchange incorrect or is it the import function that changes the regex?5
139TDQ-4712demo jobs dedupe_jobs don't workIn the DQ demo project, there is a problem with the stewardship console access. The demo jobs should run without any problem when executed in order c0, c1, c2, c3. Actually, I've got errors in c2 sometimes and in c3 always because of the stewardship console. Exception in component tStewardshipTaskInput_1 com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 403: Forbidden com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.checkStatusCode(HttpTransportPipe.java:196) com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:168) com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83) com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:105) com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587) com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546) com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531) com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428) com.sun.xml.internal.ws.client.Stub.process(Stub.java:211) com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124) com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98) [statistics] disconnected com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78) com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107) $Proxy30.searchTasks(Unknown Source) tdqeedemojava.c3_get_cleansed_records_from_dsc_0_1.c3_get_cleansed_records_from_DSC.tStewardshipTaskInput_1Process(c3_get_cleansed_records_from_DSC.java:2061) tdqeedemojava.c3_get_cleansed_records_from_dsc_0_1.c3_get_cleansed_records_from_DSC.runJobInTOS(c3_get_cleansed_records_from_DSC.java:2975) tdqeedemojava.c3_get_cleansed_records_from_dsc_0_1.c3_get_cleansed_records_from_DSC.main(c3_get_cleansed_records_from_DSC.java:2832)1
140TDQ-4713for the javaudi can not define the "Number of Result Shown", so will show large data in report1. create a javaUDI and set its "Category" to "User Defined Frequency" 2. create a column analysis which used the javaUDI 3. check the result in the "analysis Result page", if the data in database is larger, the javaUDI show 10 items. 4. create a report file about the analysis, generate. check the genereated report file, for the columns which applied the javaUDI shows many items, we'd better can control the number of columns in the report file for the javaUDI 5
141TDQ-4714update aggregatedDefinitions in some definition files to avoid proxy1.open the definition files(Connection Overview/Catalog Overview/Schema Overview/).check the aggregatedDefinitions. .eg. tag in the Schema Overview '<aggregatedDefinitions href="../../../.Talend.definition#_hgO7YMYUEd27NP4lvE0A4w"/>' is incorrect.it should be like '<aggregatedDefinitions href="Table Overview#_hgO7YMYUEd27NP4lvE0A4w"/> <aggregatedDefinitions href="View Overview#_lNIE0MbNEd2d_JPxxDRSfQ"/> ' 2.open the category definition files(Simple Statistics/Phone Number Statistics/IQR/Mean/Range/Summary Statistics/Text Statistics),you could see some tags like '<aggregatedDefinitions href="Blank Count.definition#_ccHq0xF2Ed2PKb6nEJEvhw"/>'. if get the aggregatedDefinitions from this definition.the object of Blank Count indicator will be a proxy,because its name in file system is Blank_Count_0.1.definition. we need to update the name in tag '<aggregatedDefinitions...>' at somewhere. we could use the IndicatorDefinition.getAggregatedDefinitions() to debug so that judge if it is a proxy.13
142TDQ-4720Use of custom patterns in tPatternCheck causes issues after re-opening jobWhen using custom patterns in tPatternCheck it seems that the component is still looking/expecting a 'Pattern type' to be selected from the drop down list of Regex patterns in the repository. Unchecking 'custom pattern' then re-checking 'custom pattern' appears to clear the issue somehow. In addition, when re-opening a job which uses a custom pattern, the job will fail to compile with the following error in the tPatternCheck component: "Unknown value in the list / Value set not supported by the component" Unchecking and re-checking the 'custom pattern' seems again to clear the issue.5
143TDQ-4722Improve pattern selector for all components using regexIn current components, the pattern selector is a hard coded combo list in the XML component definition. By the contrary, user should be able to choose patterns from DQ library.13
144TDQ-4724Data Profiler cannot handle nvarchar typesA prospect is trying to perform Data Profiler analysis on a SQLServer table that has nvarchar columns and is getting nulls returned for the pattern analysis. Following is the email from the prospect. -After reinstalling the tool I was able to select the checkbox in the Pattern Analysis, text analysis and others that wasn´t enabled, so the result of the pattern analysis still only null values; I looked for another possible reason and I found that my data was varchar type, and the query built by the tool or the driver has some problems to handle this data type, here is the example. This is the query generated SELECT * FROM "SERVICIO_GUIAS"."dbo"."BD_Captura_Calidad_31052011" WHERE ("CALLE" IS NOT NULL ) AND ( LTRIM(RTRIM( CASE WHEN "CALLE" IS NULL THEN 'NULL TALEND' ELSE "CALLE" END )) <> '' ) AND DATALENGTH("CALLE") = (SELECT MIN(LEN("CALLE")) FROM "SERVICIO_GUIAS"."dbo"."BD_Captura_Calidad_31052011" WHERE ("CALLE" IS NOT NULL ) AND ( LTRIM(RTRIM( CASE WHEN "CALLE" IS NULL THEN 'NULL TALEND' ELSE "CALLE" END )) <> '' )) If My String is "ANGEL" USING VARCHAR DATALENGTH("CALLE") returns "5" LEN("CALLE") returns "5" USING NVARCHAR DATALENGTH("CALLE") returns "10" LEN("CALLE") returns "5" This makes that query has no results The action taken was change NVARCHAR data type for VARCHAR 8
145TDQ-4729while install portall with oracle, the database which installed portal before will disable to import "3_ORA_import_blob_generic.dmp"install portal with an oracle database as portal datamart if this database was installed before it will disable to import the dump file -- "3_ORA_import_blob_generic.dmp" and it says need to import it manually40
146TDQ-4732can not get tables for oracle dbconnection 1. create an oracle dbconnection in top 2. unfold the "Tables" node in the dbconnection, get errors. so the tables in the dbconnection can not show. in tdq also get errors when unfold the connection, but the tables can show.8
147TDQ-4733temp folder can not be deletedNULL3
148TDQ-4734Create pattern from pattern test view, doesn't get item in repositoryin pattern test view, define the regular expression, click on "Create Pattern" button type in the pattern name, "Next" - "Finish" the new created pattern editor will open but I can't get it in repository checked workspace, the new generated item is in the root folder of "Patterns"3
149TDQ-4738"Create a new connection" menu on a connection catalog or schema, the second time will get errorcreate a connection expand this connection you will get some catalogs or schema right click on it, and click the context menu -- "Create a new connection" the first time is OK, but the second time it will pop up a dialog to inform you if replace the old one if replace it, it's OK if cancel or press the key "ESC" on the keyboard it will throw an error: java.lang.IllegalArgumentException: Label tbi_tbi is already in use at org.talend.core.repository.model.ProxyRepositoryFactory.checkIfHaveDuplicateName(ProxyRepositoryFactory.java:309) at org.talend.core.repository.model.ProxyRepositoryFactory.checkFileNameAndPath(ProxyRepositoryFactory.java:252) at org.talend.core.repository.model.ProxyRepositoryFactory.create(ProxyRepositoryFactory.java:1117) at org.talend.core.repository.model.ProxyRepositoryFactory.create(ProxyRepositoryFactory.java:1096) at org.talend.datacleansing.core.ui.actions.ExportConnectionToTOSAction.run(ExportConnectionToTOSAction.java:105) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 8
150TDQ-4739Unify all export wizard for null choosing,that will not finish!1.check all export wizard as parser rule or patterns 2.if that is selected,it is not be finished. 3.set finished button to disable.3
151TDQ-4740respository with joblet , switch to talend profiler,then expand connection will show a mistaken catalog node.Create one job about tmysqlinput->logrow,then refactor to joblet named mysql,run this job. Then switch to the "Talend profiler",you will see under the db connection ,display the catalog ,.see the jpg.2
152TDQ-4747Get error when used overview template to generate a reportUsed the embedded overview template 'report_03' to generate a report, I get an error and there is no document generated! !STACK 0 net.sf.jasperreports.engine.JRException: Error executing SQL statement for : report_03 at net.sf.jasperreports.engine.query.JRJdbcQueryExecuter.createDatasource(JRJdbcQueryExecuter.java:141) at net.sf.jasperreports.engine.fill.JRFillDataset.createQueryDatasource(JRFillDataset.java:671) at net.sf.jasperreports.engine.fill.JRFillDataset.initDatasource(JRFillDataset.java:591) at net.sf.jasperreports.engine.fill.JRBaseFiller.setParameters(JRBaseFiller.java:1212) at net.sf.jasperreports.engine.fill.JRBaseFiller.fill(JRBaseFiller.java:842) at net.sf.jasperreports.engine.fill.JRBaseFiller.fill(JRBaseFiller.java:791) at net.sf.jasperreports.engine.fill.JRFiller.fillReport(JRFiller.java:63) at net.sf.jasperreports.engine.JasperFillManager.fillReport(JasperFillManager.java:402) at org.talend.dataquality.reporting.JasperReportBuilder.createSubReport(Unknown Source) at org.talend.dataquality.reporting.JasperReportBuilder.run(Unknown Source) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateReport(Unknown Source) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateDoc(Unknown Source) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(Unknown Source) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(Unknown Source) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'TDQ_OVERVIEW_INDVALUE.RUN_TIME' in 'where clause' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at com.mysql.jdbc.Util.handleNewInstance(Util.java:403) at com.mysql.jdbc.Util.getInstance(Util.java:378) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1031) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:957) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3378) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3310) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1853) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1976) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2503) at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1737) at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1888) at net.sf.jasperreports.engine.query.JRJdbcQueryExecuter.createDatasource(JRJdbcQueryExecuter.java:135) ... 14 more8
153TDQ-4748"export items" on tool bar, in some way will throw a NPEin export wizard, there are two radio buttons "Select root directory:" "Select archive file:" the "root directory" button is the default check click on "Browse" button to choose a path to export then check radio button -- "Select archive file:" while check back to "root directory" click finish button to export items, but failed and throw an error: java.lang.NullPointerException at org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter.write(FileSystemExportWriter.java:165) at org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter.write(FileSystemExportWriter.java:138) at org.talend.dataprofiler.core.ui.imex.ExportWizard$1.run(ExportWizard.java:76) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) if give the "archive file" path do this operation -- check "directory" radio button then check back to "archive file" will get this java.lang.NullPointerException at org.talend.dataprofiler.core.ui.imex.model.ZipFileExportWriter.write(ZipFileExportWriter.java:67) at org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter.write(FileSystemExportWriter.java:138) at org.talend.dataprofiler.core.ui.imex.ExportWizard$1.run(ExportWizard.java:76) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) 5
154TDQ-4752should we add the dependency for the analysis and systems indicators1. create a column analysis, add simple indicators. 2. change some information for the simple indicators--name, database definition (especially add a new one). 3. try to export the analysis should we select the systems indicators automatically-- the system indicators has been added a database definition. if import the export ones to a new project, can not run the analysis successfully. for 5.0 one(for 5.1 is ok--the systems' name in analysis will not change): the if we change system indicators' name , then import the analysis which used the changed indicators to a new project, because of the indicators' name is the changed one in the analysis, so it can not find the corresponding one.8
155TDQ-4753remove a schema of connection in DI perspective, the dependency doesn't be deleted in DQ which is depends on this schemacreate a connection in DQ perspective, it will load the all table schema create an analysis with this connection, select some columns or table to analyze turn to DI perspective, remove the table schema which is used by DQ back to DQ perspective, the columns or table are removed from analysis this is correct but checked in the file model, the dependency is still there5
156TDQ-4754run analysis get error with file connection1. with the attachment file to create a file connection, and with the default settings. 2. use column "Column0" to create a analysis with row count indicator. 3. run , and get the followings java.lang.NumberFormatException: For input string: "" at java.lang.NumberFormatException.forInputString(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at org.talend.dq.indicators.DelimitedFileIndicatorEvaluator.executeSqlQuery(DelimitedFileIndicatorEvaluator.java:121) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:114) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:168) at org.talend.dq.analysis.DelimitedFileAnalysisExecutor.runAnalysis(DelimitedFileAnalysisExecutor.java:67) at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:109) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:154) at org.talend.dataprofiler.core.ui.action.actions.AnalysisExecutorThread.run(AnalysisExecutorThread.java:86) at java.lang.Thread.run(Unknown Source) 3
157TDQ-4755Unnecessary page in the new time analysis wizardWhen we create a time analysis by selecting a column in the dq repository view, there is an unnecessary page. See attached capture.3
158TDQ-4757command line initialize local workspace will create a "TOP_DEFAULT_PRJ" project1. while I open command line window, it will throw an error java.io.IOException: Stream closed at java.io.BufferedInputStream.getInIfOpen(Unknown Source) at java.io.BufferedInputStream.read1(Unknown Source) at java.io.BufferedInputStream.read(Unknown Source) at java.io.FilterInputStream.read(Unknown Source) at jline.WindowsTerminal.loadLibrary(WindowsTerminal.java:297) at jline.WindowsTerminal.initializeTerminal(WindowsTerminal.java:240) at jline.Terminal.setupTerminal(Terminal.java:75) at jline.Terminal.getTerminal(Terminal.java:26) at jline.ConsoleReader.<init>(ConsoleReader.java:191) at jline.ConsoleReader.<init>(ConsoleReader.java:186) at jline.ConsoleReader.<init>(ConsoleReader.java:175) at org.talend.commandline.client.util.ConsoleUtil.set(ConsoleUtil.java:33) at org.talend.commandline.CommandLineApplication.start(CommandLineApplication.java:83) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) 2. then I initialized local workspace, and it will create a "TOP_DEFAULT_PRJ" project (the application created it, I didn't) ERROR: Plug-in "org.talend.datacleansing.core" was unable to instantiate class "org.talend.datacleansing.core.service.TD QItemService". org.eclipse.core.runtime.CoreException: Plug-in "org.talend.datacleansing.core" was unable to instantiate class "org.tal end.datacleansing.core.service.TDQItemService". at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.throwException(RegistryStrategyOSGI.java:194) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:186) at org.eclipse.core.internal.registry.ExtensionRegistry.createExecutableExtension(ExtensionRegistry.java:904) at org.eclipse.core.internal.registry.ConfigurationElement.createExecutableExtension(ConfigurationElement.java:2 43) at org.eclipse.core.internal.registry.ConfigurationElementHandle.createExecutableExtension(ConfigurationElementH andle.java:55) at org.talend.core.GlobalServiceRegister.findService(GlobalServiceRegister.java:125) at org.talend.core.GlobalServiceRegister.isServiceRegistered(GlobalServiceRegister.java:81) at org.talend.commandline.util.ItemsHelper.<clinit>(ItemsHelper.java:104) at org.talend.commandline.util.JobHandler.<init>(JobHandler.java:81) at org.talend.commandline.command.CommandProcessor.<init>(CommandProcessor.java:92) at org.talend.commandline.command.CommandProcessorSwitch.<init>(CommandProcessorSwitch.java:44) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source) Caused by: java.lang.NullPointerException at org.talend.datacleansing.core.service.TDQItemService.<init>(TDQItemService.java:90) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:184) org.eclipse.core.runtime.CoreException: Plug-in "org.talend.datacleansing.core" was unable to instantiate class "org.tal end.datacleansing.core.service.TDQItemService". at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.throwException(RegistryStrategyOSGI.java:194) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:186) at org.eclipse.core.internal.registry.ExtensionRegistry.createExecutableExtension(ExtensionRegistry.java:904) at org.eclipse.core.internal.registry.ConfigurationElement.createExecutableExtension(ConfigurationElement.java:2 43) at org.eclipse.core.internal.registry.ConfigurationElementHandle.createExecutableExtension(ConfigurationElementH andle.java:55) at org.talend.core.GlobalServiceRegister.findService(GlobalServiceRegister.java:125) at org.talend.core.GlobalServiceRegister.isServiceRegistered(GlobalServiceRegister.java:81) at org.talend.commandline.util.ItemsHelper.<clinit>(ItemsHelper.java:104) at org.talend.commandline.util.JobHandler.<init>(JobHandler.java:81) at org.talend.commandline.command.CommandProcessor.<init>(CommandProcessor.java:92) at org.talend.commandline.command.CommandProcessorSwitch.<init>(CommandProcessorSwitch.java:44) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source) Caused by: java.lang.NullPointerException at org.talend.datacleansing.core.service.TDQItemService.<init>(TDQItemService.java:90) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:184) java.lang.NullPointerException at org.talend.datacleansing.core.service.TDQItemService.<init>(TDQItemService.java:90) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:184) at org.eclipse.core.internal.registry.ExtensionRegistry.createExecutableExtension(ExtensionRegistry.java:904) at org.eclipse.core.internal.registry.ConfigurationElement.createExecutableExtension(ConfigurationElement.java:2 43) at org.eclipse.core.internal.registry.ConfigurationElementHandle.createExecutableExtension(ConfigurationElementH andle.java:55) at org.talend.core.GlobalServiceRegister.findService(GlobalServiceRegister.java:125) at org.talend.core.GlobalServiceRegister.isServiceRegistered(GlobalServiceRegister.java:81) at org.talend.commandline.util.ItemsHelper.<clinit>(ItemsHelper.java:104) at org.talend.commandline.util.JobHandler.<init>(JobHandler.java:81) at org.talend.commandline.command.CommandProcessor.<init>(CommandProcessor.java:92) at org.talend.commandline.command.CommandProcessorSwitch.<init>(CommandProcessorSwitch.java:44) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source)5
159TDQ-4760Test existing mapping methods3 approaches: - datamaster (Protégé plugin, license MPL) - Kaon2 - RDBToOnto Aim of this work item: A. Test datamaster on our tbi database. What's the result? B. Can the other methods be tested too? Answer the following questions: 1. Are these methods only useful to build ontologies from data? 2. can we reuse one of these approaches to map data with ontologies? 3. which one is best (pros and cons)? 3
160TDQ-4769Enable the use of hadoop 1.0 in tMatchGroupHadoopEnable Hadoop 1.0 compatibility in the tMatchGRoupHadoop component.8
161TDQ-4770Use the same layout for analysis summary in the overview analysis editor as in the column analysis editorSee the current layout of the "analysis summary " section (see screen capture in TDQ-4377 ). Change the layout of this section so that it's similar to the "Analysis summary" section of the column analysis. See attached picture1
162TDQ-4771try to import a 401 file by logon window, the project will no show on the project list, logon other project, there is some error.try to do migration for 401 project by logon window. but the project you have imported will show on the project list, as the bug summary described. should make sure both logon window and import button work well. 13
163TDQ-4772after the "create Rule" function in the parser rule test editor, the original parser rule will be null.1. create a parser rule name 'aa' 2. add corresponding items. 3. click the "Rule test" icon, in the pop up editor, click "create Rule" icon, a new parser rule will be created, check -- reopen the original parser rule--'aa', the items of 'aa' all lose.5
164TDQ-4773After delete the report document, the node didn't refreshwhen I delete the report the document, the document still exists in the repository, after refresh, it disappared, it also not exists in the Recycle Bin!6
165TDQ-4774Migrated report item from an ealier version(4.1.x--doesnot contain DB config in editor), the default DB config in editor is HSQLmigrate project from released 4.1.4 in 4.1.4, the report file doesn't contain DB config in it but our current build does if in 4.1.4 user config a Mysql or oracle as report DB after migrate to current build, report DB config in editor will be default with HSQL what if the user want mysql or oracle that which user deployed before ?2
166TDQ-4775Create org.talend.repository.antrlid.ui.nlCreate the nl fragment related to org.talend.repository.antrlid.ui and add it to the appropriate feature. 2
167TDQ-4781Do a nominal column correlation analyze with an empty column, it will throw erroras the summary said: if analyze a column which has no data, it will throw this error java.lang.NullPointerException at edu.uci.ics.jung.visualization.ISOMLayout.getISOMVertexData(ISOMLayout.java:222) at edu.uci.ics.jung.visualization.ISOMLayout.adjustVertex(ISOMLayout.java:183) at edu.uci.ics.jung.visualization.ISOMLayout.adjust(ISOMLayout.java:167) at edu.uci.ics.jung.visualization.ISOMLayout.advancePositions(ISOMLayout.java:128) at edu.uci.ics.jung.visualization.LayoutDecorator.advancePositions(LayoutDecorator.java:64) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.prerelax(DefaultVisualizationModel.java:209) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.setGraphLayout(DefaultVisualizationModel.java:137) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.<init>(DefaultVisualizationModel.java:82) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.<init>(DefaultVisualizationModel.java:66) at org.talend.dataprofiler.core.ui.chart.jung.JungGraphGenerator.generate(JungGraphGenerator.java:122) at org.talend.dataprofiler.core.ui.chart.jung.JungGraphGenerator.generate(JungGraphGenerator.java:109) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnCorrelationNominalAndIntervalMasterPage.createPreviewCharts(ColumnCorrelationNominalAndIntervalMasterPage.java:419) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnCorrelationNominalAndIntervalMasterPage.refresh(ColumnCorrelationNominalAndIntervalMasterPage.java:522) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:189) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:286) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 3
168TDQ-5073tmatchgroup right-click, choose configuration wizard,there is an errorNULL5
169TDQ-4783the detail view can not show the pk number correctly for adding a new pk column1. create a dbconnection. 2. unfold a table which contains a pk, check the detail view it is correctly-such as the number is 2. 3. in the database, added a new column, and also set the column as pk. 4. reload the column list, recheck the pk number it change to 5, in fact it is has only 3 columns, refer to the pic.5
170TDQ-4784when saving an invalid column set analysis, the inform dailgo won't show(columns can not come from more than one table/view ).1. create a column set analysis, select columns from more than one table/view. 2. try to save the analysis, only a refresh progress bar show and then disappear. 3. try to run the analysis, there will be a dialog pop-up to inform column can not comes from more than one table or view. in fact , when save the analysis, the inform dialog also should pop-up3
171TDQ-4791Improve reports look&feelThe current bar charts in the generated reports are not sexy enough. Try several options in order to get a better look&feel Then apply on all reports. 8
172TDQ-4794Use the look&feel in all reports in the studioNULL20
173TDQ-4795In "t(Oracle|MySQL)(Valid|Invalid)Rows" components, output contents do not correspond to output schemaThe generated SQL query begins with "SELECT *" instead of "SELECT <columns>", which makes it impossible to retrieve correct content according to output schema. (see code of generated job) If the order of columns does not correspond to that in the database, the output columns will be shifted.5
174TDQ-4804Use the look&feel in all reports in the DQ portal for OracleNULL5
175TDQ-4820Create a TUJ to check that the store on disk option of the tRecordMatching component gives the same results as the in memory optionCreate a TUJ that validates TDQ-15132
176TDQ-4822Propagate Table Alias in Schema when "guess schema" is activatedin the tOracleValidRows and the other similar components, the "guess schema" button generates the schema according to the DQ rule query (select DQ rule and click on "guess query" before). When the DQ rule has a join clause, aliases are used for table names. In this case, each database column should be qualified with the table alias. For instance, PRENOM is a column name, it should be changed to A.PRENOM where A is the table alias (it can be something else according to the DQ rule item). 13
177TDQ-4823Use DQ rules in all tXXX(In)validRows componentsImplement the same feature as TDQ-4805 for the other components. 8
178TDQ-4828Add where clause for DQ rule in tOracle(In)ValidRowsWhen the regex validation is chosen, a where clause can be applied in order to filter the analyzed rows. When the dq rule validation is chosen, add the possibility to write a where clause in order to filter the analyzed rows. This where clause will be concatenated with the where clause of the DQ rule, but the negation of the DQ rule (invalid rows) only applies on the where clause of the DQ rule, not on the where clause that filters the data. 2
179TDQ-4829Generate a job to retrieve the rows that are valid or invalid against a DQ ruleIn DQ rule analysis, allow the user to right-click on the indicator in the result page. This opens a menu with - retrieve invalid rows - retrieve valid rows Each menu will generate the job using a tXXX(In)validRow component and a file output (same as for the job generated from a pattern indicator). The component will be configured appropriately with the DQ rule and the data filter information. 8
180TDQ-4830SourceFile could not be duplicated.java.lang.NullPointerException org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.getSelctionNode(DuplicateAction.java:229) org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.selectAndReveal(DuplicateAction.java:196) org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.run(DuplicateAction.java:128) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:77) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) 8
181TDQ-4831SourceFile and Jrxml could not be dropped for moving.1.create a new folder in sourcefile folder or jrxml folder 2.select a file node in sourcefile folder or jrxml folder 3.drop it to your created folder. 4.that could not be drop in the folder and no error shows.13
182TDQ-4832Backport TDQ-4654 to dqPortal (Threshold violation don't appear for phone number indicators)NULL5
183TDQ-4836the jrxml folder lost in the import and export dialog.the jrxml folder lost in the import and export dialog. so after the TDQ-4703 function worked, can not export/import the report which use the jrxml file correctly.8
184TDQ-4845the node of "Recycle bin" lost after delete a generated document of reportthe node of "Recycle bin" lost after delete a generated document of report2
185TDQ-4848Configuration Wizard of tMatchGroup is not displaying proper valueConfiguration Wizard of tMatchGroup is not displaying proper value. It seems to depend on the type of component that are used before on the flow. (the job run without problems) 8
186TDQ-4849Failed to generate code with tRecordMatching if "store on disk" checked && blocking key column not in output schemaConsole output: Execution failed : Failed to generate code. [org.eclipse.emf.codegen.jet.JETException: InvocationTargetException in tRecordMatching_TDQ4820_memory_vs_disk job]3
187TDQ-4853Getting NullPointerException when switching DB connections for Functional Dependency AnalysisI created a Functional Dependency Analysis using db connection "A". I saved it and ran it successfully. I changed the db connection to "B" which points to the same DB as connection "A". I clicked on the "Determinant Columns:..." and got no response. I tried to save it and it gave me a null pointer exception. I closed the analysis and tried to reopen it and got a null pointer exception. I found this in TOSDQ and Talend Platform Big Data Edition5
188TDQ-4854Report generating failed after the datamart is upgraded.After migrating datamart from lower version by "Check" the connectivity database settings section of report page , I cannot generate the report. 8
189TDQ-4855the reload function seems have some problem with oracle.1. create an oracle dbconnection, with user "aa", set the schema "bb". 2. check the dbconnection in repository, correct, it is "bb" schema. 3. open the dbconnection's editor, leave the schema parameter null. so all the schemas in the dbase should show. recheck the repository, only "aa" schema show , reopen the "Database Connection" wizard by clicking "edit". the schema parameter was set "aa' -- which should be not set. when do the same operations for mysql, the function works well. but a redundant dialog pop-up. should not be. test on trunk 79203-5.1.0 and r79146-V5.0.3NB it works well5
190TDQ-4856Some aggregate href reffering to definition labels are not correct in definition file , update them as same as "label" in definition file.The refactoring of TDQ-4714 caused some hrefs of aggregate tag not same to the "label" attribute of definition, update them.2
191TDQ-4860Create a TUJ for TDQ-4496Create a TUJ based on the job attached in TDQ-44961
192TDQ-4867Upgrade basic reports of the studioNULL20
193TDQ-4870Run "Import Build-in JRXML", for columnset report, after doing export and then import, run the columnset report get errorNULL13
194TDQ-4871backport tRecordMatching TUJs to branch 5.0NULL1
195TDQ-4872The upper box in the Rule tester view is labeled "rule" where it should be labeled something like "string, data or text..." In the Rule tester view in the profiling perspective of the Studio, the first box where to write the string of data you want to test against the user-defined rules and the system pre-defined rules is labeled "rule". See attached figure This is a bit misleading. I think this box should be labeled something like "string or data"2
196TDQ-4884SQL Server 2008 via NTLM can't retrieve new schemaI created a new schema called "ABC" in SQL SERVER 2008 and create a new table called "DemoABC". But when i create metadata in TOS for DQ by DB type "Microsoft Sql Server" via NTLM, I can't find Schema "ABC" and Table "DemoABC". But if I create metadata in TOS for DQ by DB type "Microsoft SQL SERVER 2005/2008", I can get them. A topic in Talend Community will explain this issue in detail. http://www.talendforge.org/forum/viewtopic.php?pid=79844#p79844 13
197TDQ-5722DB connection_Edit HyperSql Database connection, remove the default value "ifexists=true" from addional parameter can not save the connection.Edit HyperSql Database connection, remove the default value "ifexists=true" from addional parameter can not save the connection. Base on case:Test Case ID TDIQA-50378
198TDQ-4894Delete the built-in jrxml template into recycle, import built-in again seems nothing happeneddelete the built-in jrxml templates into recycle bin keep them in recycle import built-in templates second time no information that tell me like "there are some in recycle" or some what .... it just looks like import built-in templates "failed" 5
199TDQ-4898No need to check connection of analysis when the analysis does not need to be refreshedCreate a column analysis on an Oracle connection Run the analysis. Stop the DBMS server Create a report with this analysis uncheck the checkbox called "Refresh" in order to avoid the computation of the analysis. Save the report run the report It shows an error message as in the attached picture. 1. The error message is incomplete: the name of the analysis is not displayed and the user cannot understand clearly the message. 2. There should be no connection check (connection of the analysis) when we don't need to execute the analysis. All the information are stored in the analysis. 8
200TDQ-4906Incorrect message when datamart database is not availableCreate a report with a configuration of the datamart. Put a non existing IP for the database of the datamart in the report editor (see attached picture). Run the report. The studio will be frozen during several minutes, until the connection times out. Then there is a message to say that the database version is not correct. 1. it would be nice if we could avoid to freeze the studio during the database connection, and also lower the time out limit. 2. the message is not appropriate, change it according to the real error3
201TDQ-4910New Analysis Wizard help is not displayed correctlyThe help displayed in the New Analysis wizard is not displayed correctly. See screenshot that shows truncation. 5
202TDQ-4913Create a Distinct count indicator which computes the SQL distinct countShare this indicator on Talend Exchange. the expression is: SELECT COUNT(DISTINCT &lt;%=__COLUMN_NAMES__%>) FROM &lt;%=__TABLE_NAME__%> &lt;%=__WHERE_CLAUSE__%>5
203TDQ-4914Enable use of reference projects in DQ Repository When using the DQ Profiling Perspective on a TAC project, the metadata in a reference project is not shared. This is also true of Analyses defined in the reference project are not avilable either. When we add a reference project to a DQ project, we should be able to see all items (connection, libraries, analysis...) from the reference project in the DQ repository view. Do we need to display the analysis and reports from the reference project? not sure.13
204TDQ-4916Profiler does not allow the creation of new AnalysesRunning a column set profiling analysis against 12 million records, the system crashes with a java heap error. When I restart the studio, the analysis is renamed "null 0.1". I deleted and it assumed it correct name in the recycle bin. I deleted it from the recycle bin. From then on, I cannot create new analyses. I uninstalled and reinstalled, carried out the same operation to get the same result. 5
205TDQ-4922Failed to execute tLaunchDQReport componet to generate a report filewhile I tried to generate a report file with tLaunchDQReport component I got this error in .log file org.eclipse.core.runtime.AssertionFailedException: null argument:The dialog should be created in UI thread org.eclipse.core.runtime.Assert.isNotNull(Assert.java:85) org.eclipse.jface.dialogs.IconAndMessageDialog.getSWTImage(IconAndMessageDialog.java:282) org.eclipse.jface.dialogs.IconAndMessageDialog.getErrorImage(IconAndMessageDialog.java:233) org.eclipse.jface.dialogs.MessageDialog.<init>(MessageDialog.java:179) org.eclipse.jface.dialogs.MessageDialog.open(MessageDialog.java:360) org.eclipse.jface.dialogs.MessageDialog.openError(MessageDialog.java:431) org.talend.datacleansing.core.ui.ReportRunnerApplication.start(ReportRunnerApplication.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) 8
206TDQ-4926"Empty recycle bin" can't do "force to delete" and select all the items in the "Recycle Bin" then right click "delete" ,can't delete the selected items1."Empty recycle bin" can't do "force to delete" 2.Select all the items in the "Recycle Bin" then right click "delete" ,can't delete all the selected items 23
207TDQ-4929the genereated job can not run successfully by "remove duplicate" for columlns contains "()"1. create a column analysis which analyze a colum contains "()", such as "name(test)". 2. select the Simple Statistics indicators, run. 3. on result page, select "unique count" ,"distinct count" or "duplicate count" can get a menu "remove duplicates". 4. the generated job can not run correctlly. no errors, just an inform pic notes : for the column which doesn't contains "()", can run well11
208TDQ-4931Avoid the use of Sun's classesReplace sun.security.action.GetPropertyAction in DelimitedFileReader8
209TDQ-4935Export report script does not handle OS XMac OS X is now an officially supported platform, so the "export report script" command should also generate a batch script for OS X. In addition to RunReport.bat and RunReport.sh, add a RunReport.command file that calls the Studio executable like this: {noformat} <Studio Home>/Talend-Studio-macosx-cocoa.app/Contents/MacOS/Talend-Studio-macosx-cocoa -nosplash -application org.talend.datacleansing.core.ui.ReportRunner RunReport.properties -consoleLog -data <workspace location> {noformat} .command files are recognized by the Mac Finder as shell scripts chmod +x is still necessary for the script to run.5
210TDQ-4936for the "mean" indicator under "Summary statistics" can not get same result sql and java engine for column no values.1. create a column analysis, select an integer columns 2. select the summary statistics 3. run with sql and java engine can not get same result, because some rows is Null. we do "mean", sql doesn't count the Null ones, but java engine include it.13
211TDQ-4939when do migration from 401, some dbconnections name are same1. create a dbconnection in di named "a" in 401 build . 2. turn to dq perspective, import the "a" dbconnection to dq. 3. do migration to 5.1(both import and logon window). 4. check the dbconnection in repository, there is two "a". check in navigator ,it is different 5
212TDQ-4942when try to change an analysis to an exist one, the inform dialog will pop up twice1. create two analysis, named "a" and "b' 2.try to change the analysis name "b" to "a', the inform dialog will pop-up twice("The item already exist,check if it's in Recycle Bin or another folder"). in my opinion we should only pop-up once.2
213TDQ-4943The error about ""dqrule" miss dependency:Row Count" when import DQ Rules dependency When import DQ Rules dependency ,the error about ""dqrule" miss dependency:Row Count" appeared.13
214TDQ-4944Connection error with DQ Portal and Mozilla ExplorerI am using Mozilla explorer: During the execution of connection testing of data sources in the dq portal I get the error message "error during connection test" When I use Internet explorer this message does not show up 8
215TDQ-4945try to create a column analysis by right click the view in the table analysis.1. create a table about a view. 2. in the table anslysis, right click the view-> column analysis. 3. the wizard, pop up to create a new analysis , after you set the name of the new analysis, the "Next" becomes available, click it, the select columns dialog pop-up, in fact, the "Next" should be un-available, the new created columns comes from the view. now, the "Next " is available, and the new created analysis contains no columns, there is an error pop-up. errors in Details->Additional Information .8
216TDQ-4948try to delete an item by clicking the "Delete" on keyboard doesn't workfocus on an dq element on repository, press "Delete" on keyboard, no action. case:TDQQA-1329.5
217TDQ-4949the "Enter" on NUMERIC KEYPAD can not open the item's editor when focus is on an dq item.focus on a dq item, press "Enter" on NUMERIC KEYPAD, can not open the editor, but the other "Enter" on keyboard can open. case: TDQQA-52735
218TDQ-4950Missmatches with tStandardizeRow due to inconsistency between Lucene analyzer and ANTLR parserExample: For the word <didn't>, during indexing, StandardAnalyzer of Lucene consider it as one word to save in the index. However, during the search, ANTLR cut it into 2 tokens "didn" and "t", none of them can be found in the index. See also testProcessIndexForMultiWord() in IndexStandardizerTest, the word <d'antin> can not be found. One solution will be modifying the parser rule, so that it doesn't cut the word by apostrophe.13
219TDQ-4951Add an option in the "Profiling" preference page to not switch automatically between perspectiveCurrently, the studio switches from the DI perspective automatically to the DP perspective when a DP editor gets the focus. There used to be a pop-up to ask the user if he wants to switch or not. This pop-up does not exist anymore? Also, we must add an option in the preference page: a check box: "automatically switch between perspective" in the "Profiling" page. When checked the perspectives will switch automatically When unchecked, they won't. The default value is "checked" If we can restore the initial pop-up that asks the user what he wants, then this pop-up stores the user preference in the preference page. 8
220TDQ-4955Junit tests for 5.1M2 tasksComplement the missing JUnit test for all 5.1M2 tasks.40
221TDQ-4956import the exported file to a project which has noe file have errors (1). open a new project, create a column analysis, select system indicators , analysis can run well. (2). change some information about the system indicators which be used by the analysis: one change name, one change description/purpose, one change definition. (3). export the analysis, have to select the system indicators. export as a zip file. (4)-1. put the zip file is in a path which contains a Chinese word, open another new project, try to import the analysis you just exported result: get warnings, and the systems indicators which name changed will also be imported, and the original still there.warnings and system indicators still be there13
222TDQ-4957import the export file to 5.1 project (1). open a new project, create a column analysis, select system indicators , analysis can run well. (2). change some information about the system indicators which be used by the analysis: one change name, one change description/purpose, one change definition. (3). export the analysis, have to select the system indicators. export as a zip file. (4)-1. open a new project, create a dbconnection named "aa", import the exported file in step 3. have found that the "aa" have been deleted, can refer to the log, we should not delete "aa" (4)-2 open a new project, create a dbconnection named "aa", create a column analysis named "analysisaa". import the exported file in step 3, errors show. recheck the reporsitory, the "analysisaa" disappear, dbconnection "aa" is ok. only the analysis in zip file imported, but no columns, why analysis in zip file can import-- the used indicators can not imported, why the original analysis in the project be deleted. if an item in repository is dependend by oter items, even if we checked "overwrite" the item can not be overwriten right? so the new one can not be imported. in step (4)-1 and (4)-2, in the import dialog, there is inform abount the "aa" dbconnection can not be overwrite(overwrite checked), in fact this dbconnection can be selected if overwrite check box is not checked. but now, it is not. in (4)-2 I have not test about the project contains report, but we also should make it well.23
223TDQ-4958in the sql editor click "save as" pop-up error, can not save it1. in the repository right click a table-> preview Table , or you can right click on columns->Preview. 2. in the opened sql editor, select "Save Editor as". Result, no save dialog pop-up, but errors(attached on details tab) this only reproduce on tdq, not on top8
224TDQ-4959check the usage of method CorePlugin.refreshDQView()call the method CorePlugin.refreshDQView() will refresh and redraw the DQRepositoryView, this will cost a long time sometimes, so we need to check the usage of it and replace it with the method CorePlugin.refreshDQView(Object) if possible, refresh single node instead of refresh the whole tree will get better performance20
225TDQ-4960the number behind the anlaysis and report folder can not refresh correctly.create sud folder under "Analysis" named 'foldera', create sub folder under 'Report' try to test the number behind the folder can change correctly when the analysis/report created, duplicated, delete,restore Now find issue: (1) analysis on 425, when create analysis by wizard, in sub folder the root folder number won't refresh automatically. (2) 5.1.0 and 5.0.3 when delete an analysis to Recycle bin, the root folder number won't refresh automatically. (3) 5.1.0 and 5.0.3 report sub folder create, and delete report in sub folder, the root folder number won't refresh automatically. make sure all three version work well for the refresh both analysis and reprot.8
226TDQ-4962Support for HortonWorks Data Platform (HDP) in tMathGroupHadoopSee this link. http://talendforge.org/trac/talend/changeset/79910/tis_shared/trunk/org.talend.designer.components.tishadoopprovider/components/tHDFSDelete/tHDFSDelete_java.xml there should be only one line to add to the component. 1
227TDQ-4967for the ETL job for oracle valid rows also get invalid result.issue 1 1. create an oracle analysis, add pattern on a column. 2. run the analysis, turn to "Result Page", right click on the pattern ->"Generate Job". 3. on the pop-up dialog, select "Generate an ETL job to handle valid rows" the generate job can run successfully, check the then result: the output file are all invalid ones--it should be valid. for the "Generate an ETL job to handle invalid rows" and "Generate an ETL job to handle rows" works well up to now. issue 2: for mysql the "Generate an ETL job to handle Invalid rows", jogs can not run successfully. get errors:( 'gg@qw cc.om' is a value in mysql database. the pattern is "Email Address" for a varchar column) Exception in component tMySQLInvalidRows_1 java.sql.SQLException: Invalid value for getInt() - 'gg@qw cc.om' com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929) com.mysql.jdbc.ResultSetImpl.getInt(ResultSetImpl.java:2725) test2.patterninvalidrows_1332152109312_0_1.PatternInvalidRows_1332152109312.tMySQLInvalidRows_1Process(PatternInvalidRows_1332152109312.java:626) [statistics] disconnected test2.patterninvalidrows_1332152109312_0_1.PatternInvalidRows_1332152109312.runJobInTOS(PatternInvalidRows_1332152109312.java:1104) test2.patterninvalidrows_1332152109312_0_1.PatternInvalidRows_1332152109312.main(PatternInvalidRows_1332152109312.java:972) 13
228TDQ-4968handle column names correctly for postgresql, mysql and oraclepay attention to alias which should not be quoted2
229TDQ-4973after import patterns, the sub folder of Patterns have some problemsafter import patterns, the sub folder of Patterns have some problems13
230TDQ-4974When Get Patterns ETL job ,the job can't run and the job run button can't be used1.Right click on the Patterns/Regex folder in Repository. 2.Choose Generate Jobs menu. 3.Choose Get patterns menu. After to the Integration page ,can't run the job and the button "Run job" can't be used you can refer to the "errorRunJob.png"5
231TDQ-4977DB connection and File connection have the same label, analysis got confused ..create two connections DB connection -- A, and File connection -- A then create a column analysis select columns from DB connection to analyze save this model click on link "select columns to analyze" to change the analyzed columns the wizard will show me the file connection schema it should be DB connection's ..11
232TDQ-4978Create version 5.1.0M1 in Babili and populate itNULL2
233TDQ-4979Create version 5.1.0M2 in Babili and populate itNULL2
234TDQ-4980Create version 5.1.0RC1 in Babili and populate itNULL2
235TDQ-4981Export babili translations into trunk of SVNNULL2
236TDQ-4982Export babili translations into trunk of SVNNULL2
237TDQ-4983Export babili translations into trunk of SVNNULL2
238TDQ-4984Evolution reports does not work with customized indicatorsAt a POC at INRIA we created some customized indicators based on SQL queries. While creating reports "evolutive" on these indicators we had no evolutive data at the end. Only last value.13
239TDQ-4986All the failed tests on the test platformHere's the list of failed JUnits actually on trunk: (from http://192.168.0.4:8080/job/18-Studio_JUnit_trunk/67/testReport/?) from the above link you can see the reason for error for DQ: org.talend.dataquality.standardization.main.test.BooleanQueryTest.testAnd junit.framework.TestSuite.org.talend.dataquality.standardization.query.test.FirstNameStandardizeTest org.talend.dataquality.matching.date.pattern.DatePatternRetrieverTest.testInitModel2Regex org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testCreateIndex org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testGetSearchResultStringStringMapOfStringStringBoolean the following error seems can be fixed by set the path string like "data/TalendGivenNames_index", can try to do Error Details directory '/home/build-admin/Products/V5.1.0NB_r80181/swt/V5.1.0NB/swt_510/SWT-r80181-V5.1.0NB/data/TalendGivenNames_index' does not exist for DI: test.common.ErrorMessageTestCase.testFailingToLoadTestCase org.talend.metalanguage.jobscript.test.Emf2JobscriptTest.testGenerate org.talend.metalanguage.jobscript.test.Jobscript2EmfTest.testGenerate org.talend.commons.utils.time.TimeMeasureTest.test org.talend.commons.utils.tracer.StatisticsTracerTest.testStatisticTracerAndTraceToFile 3
240TDQ-4989Add an option to escape special characters and key words for the queries in SynonymIndexSearcherlucene query parser accepts a set of complex syntax such as * for wildcard match. if this kind of characters exist in the original string to search, the result will be influenced. here is a list of special characters from http://lucene.apache.org/core/old_versioned_docs/versions/3_0_1/queryparsersyntax.html + - && || ! ( ) { } [ ] ^ " ~ * ? : \ this problem is mainly for tSynonymSearch, because we always search the entire string Ex: for lucene <9~17> means search <9> with 17.0 as the minimum similarity (which sould be between 0 and 1) lucene will throws an exception saying: {code} Cannot parse '9~17': Minimum similarity for a FuzzyQuery has to be between 0.0f and 1.0f ! {code} What we need to do here is sending <9\ ~17> to query parser instead of the original string <9~17>. With tStandardizeRow, we parse the string at first. most of the characters above as well as the strings containg them will be marked as UNDEFINED, which we will not search any more in the index. However, we still have a problem with some keywords: In tStandardizeRow, we incrementally match the words. That means if "TOM" matches, we continue to search "TOM OR", which will unfortunately violate the syntax of lucene query parser, because there is no right hand side of the keyword OR. {code} org.apache.lucene.queryParser.ParseException: Cannot parse 'TOM OR': Encountered "<EOF>" at line 1, column 7. Was expecting one of: <NOT> ... "+" ... "-" ... "(" ... "*" ... <QUOTED> ... <TERM> ... <PREFIXTERM> ... <WILDTERM> ... "[" ... "{" ... <NUMBER> ... <TERM> ... "*" ... {code} what we need to do here is to replace all the < OR> with < "OR"> to tell lucene that the <OR> here is just another word to search. As the replacement action will consume some extra resources, we should add it as an option but not the default behavior.8
241TDQ-4990Add the BIRT engine and the Talend engine to the DQ Portalinclude SpagoBIBirtReportEngine and SpagoBITalendEngine into the DQ Portal. See http://forge.ow2.org/project/showfiles.php?group_id=2048
242TDQ-4993Change all DQ Portal logo to 'open integration solution'Replace DQ portal background image text and information dialog text with 'data integration solution'3
243TDQ-4994reopen column set analysis about fileDelimited file all items gonereopen column set analysis about fileDelimited file all items gone11
244TDQ-4995Dashboard is empty from remote client browserLogin TDQ Portal with tdq_user, open 'KPI' and 'indicators' from menu 'dashboard', the page have no content when the login user is not in locally.8
245TDQ-4996Remove "<" brackets in the version hint message NULL1
246TDQ-4997no information about Exchange time outtry to unfold the Exchange folder, but my computer can not access the network, no time out information show, but a sub items, refer to the pic.5
247TDQ-4998Add a section "Data Quality platform internal documentation" in the "Contents" pageadd a section "Data Quality platform internal documentation" in the "content" page at the same level as "Talend User documentation". This section contents like the index page. and makes the function like the eclipse(when you change page from the "Index" page to "Contents" page, automaticaly link to place to "Contents" page) another issue: in the wizard page(look at the screenshot help.PNG), when click the help button, no action13
248TDQ-4999In "Synonym Index View", all the search results disappear while folding one of them.NULL8
249TDQ-5004the detail inform for "type" is not correct for jdbc mysql and odbc mysql1. create a jdbc(odbc) mysql dbconnection 2. check the detail view about the connection. 3. for the "type" it shows as "Generic JDBC(Generic ODBC)", and no version values shows. for type it should show as "MySQL" from case TDQQA-16945
250TDQ-5005drag some columns into functional dependecy analysis cannot executedrag some columns into functional dependency analysis run it will get a NPE error:: only the DRAG operation can cause this bug java.lang.NullPointerException org.talend.core.model.metadata.builder.connection.util.ConnectionSwitch.doSwitch(Unknown Source) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.getAnalysisDataProvider(Unknown Source) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.run(Unknown Source) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:452) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) 5
251TDQ-5019Junit org.talend.core.model.metadata.MetadataFillFactoryTest.fillTablesorg.talend.core.model.metadata.MetadataFillFactoryTest.fillTables org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsViewConnectionCatalogString org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsViewConnectionSchemaString13
252TDQ-5020Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetTablesConnectionCatalogStringBooleanorg.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetTablesConnectionCatalogStringBoolean org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetTablesConnectionSchemaStringBoolean2
253TDQ-5021Junit org.talend.cwm.db.connection.ConnectionUtilsTest.testRetrieveColumnorg.talend.cwm.db.connection.ConnectionUtilsTest.testRetrieveColumn org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetViewsConnectionCatalogStringBoolean org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetViewsConnectionSchemaStringBoolean2
254TDQ-5022Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogStringorg.talend.cwm.dependencies.DependenciesHandler#getClintDependency(org.talend.core.model.properties.Property) org.talend.cwm.dependencies.DependenciesHandler#getClintDependency org.talend.cwm.dependencies.DependenciesHandler#getAnaDependency org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogString org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionSchemaString3
255TDQ-5023Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetColumnsorg.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetColumns8
256TDQ-5024Junit org.talend.dq.analysis.explore.PatternExplorerTest.testGetInvalidRowsStatementorg.talend.dq.analysis.explore.PatternExplorerTest.testGetInvalidRowsStatement org.talend.dq.analysis.explore.PatternExplorerTest.testGetValidRowsStatement13
257TDQ-5025Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogStringorg.talend.cwm.dependencies.DependenciesHandler#getClintDependency(org.talend.core.model.properties.Property) org.talend.cwm.dependencies.DependenciesHandler#getClintDependency org.talend.cwm.dependencies.DependenciesHandler#getAnaDependency org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogString org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionSchemaString13
258TDQ-5026Junit org.talend.dataprofiler.core.tdq.migration.CreateParserRuleFolderTaskTest org.talend.dataprofiler.core.tdq.migration.CreateParserRuleFolderTaskTest 5
259TDQ-5027some issue about dqportal find some issue about dqportal: issue 1: (1). when try to generate a reprot by dqportal, select Header:yes (2). nothing generated. if select Header for 'no', work well. issue 2: for the desinger, create sheet1 dependes table1, preview well, create sheet2 depende on table2, try to preview get errors.refer to the pic attached(if the two sheet from a same table, work well). 13
260TDQ-5028TDQ portal with oracle as datamart cannot work wellinstall portal with oracle -- portal datamart and report datamart failed to visit any functions, throw a 404 error just can login ..3
261TDQ-5030Text statistics indicators do not support some of mssql data typesome of mssql data type like "text", "ntext" don't be supported by text statistics indicators8
262TDQ-5040labels of Analysis subcategory are improperly handled(To be detailed) ViewerDataFactory class. {code} 44 for (AnalysisCategory subCategory : category.getSubCategories()) { 45 subCategories.add(new AnalysisTypeNode(subCategory.getLabel(), subCategory.getLabel(), typeNode)); 46 } {code} CategoryHandler {code} public static String getLabel(String categoryLabel) { String messageKey = Messages.getString("AnalysisType." + categoryLabel.replaceAll("\\s*", PluginConstant.EMPTY_STRING));//$NON-NLS-1$//$NON-NLS-2$ if (messageKey.startsWith(MessagesCore.KEY_NOT_FOUND_PREFIX) && messageKey.endsWith(MessagesCore.KEY_NOT_FOUND_SUFFIX)) { return categoryLabel; } return messageKey; } {code}5
263TDQ-5041Include analysis description in reportsNULL5
264TDQ-5042In generated query scripts (view rows in explorer), analysis descriptions are not commented correctlyfor descriptions containing multiple lines, \-\- even when there are carriage returns5
265TDQ-5043In DQ repository, sort items by type (folders then analysis) in ascendant alphabetical ordersee if anything reusable from DI repository8
266TDQ-5044the job generate by "Generate Job->generate an ETL Job to handle rows" have some issue1. create a postgresql analysis with pattern. 2. on resulg page select the pattern "Generate Job->Generate an ETL Job to handle rows" 3. run the job all columns go to outPattern file, in fact some items are inPattern and some are out(issue 1). reopen the job, and click the "Edit schema" of the tPatternCheck component, and "cancel" the popup dialog. re-run the job, can not successfully(issue 2)--also for mysql and oracle. for issue 1: use the pattern Regex->number->Contains numbers13
267TDQ-5046Issues related "Source Files" folder in dq repository NULL5
268TDQ-5050<composite tag won't disappear in analysis file while <component tag is gone in report file.Watch picture in attachment.8
269TDQ-5051"Remove Anaysis" menu item is not in the right placethis action removes the selected analysis from the report. it should not be placed on the analysis itself.3
270TDQ-5052Publish Job on TDQ PortalAdd the ability to deploy jobs into TDQ Portal server. Base on http://jira.talendforge.org/browse/TDI-971 ,add another preference page to config TDQ Portal connection informations and add an action for publish jobs. The TDQ Portal directory is 'tdqportal'. 8
271TDQ-5054can not open project migartion from 4.0.1 and 4.1.31. on logon window try to import a 401 project and 4.1.3 project 2. open the new imported project, get errors-- can not open refer to the file on "Details" tab 13
272TDQ-5068No need to copy the HelpClass.javajet from plugin: *.components.localprovider to *.components.tdqproviderfor all these tXXX(In)validRows in TDQ-4823, Please make good use of the line as the following: {code} <%@ include file="@{org.talend.designer.components.localprovider}/components/templates/DB/Input/HelpClass.javajet"%> {code} Please refer to the javajet file: tHiveInput_begin.javajet.2
273TDQ-5069After user modified system indicator's label, it's hard for user to find them in indicator selection dialogafter I changed a system indicator's label, for eg: "row count" to "rc" in the indicator selection dialog, it's still "row count" shown to me 5
274TDQ-5070Encoding issue with saving generated sql query actionIn windows system for western european users, the default charset of text editors in eclipse is cp1252. If we run an analysis whose description contains spécial characters such as "é", and then try to save the script, or if we create a sql source via the wizard. These characters will become rectangles. No configuration in the studio can solve this until now.8
275TDQ-5072give more information in the help page about the column set analysisSee DOCT-4453
276TDQ-5076Implement Benford's Law: Use by Accountants to detect possible cases of FraudBenford's law is used by accountants to detect possible instances of fraud based on the distribution of digits in numbers. http://en.wikipedia.org/wiki/Benford%27s_law It would be good to add this to the DQ Profiler. Target audiance would be Forensic Accounting teams such as KPMG, Accenture, PCW, ... http://testingbenfordslaw.com/ 13
277TDQ-5077Different filters separated by commas do not work in the Package Filter wizard for the DB connectionsIn the new "Package Filter" wizard created on database connections, setting one filter in the wizard works well (see the first capture). But when I tried using several filters separated by commas, I didn't have any results in the connection _ all sub-nodes have disappeared _ although the wizard says that I can use several filters (see the second capture). The second point I want to raise here is that you must type the complete name of the catalog/schema in the wizard when filtering your connection in order to have correct results. When I typed part of the catalog/schema name and clicked Finish all sub-nodes disappeared from the connection (see the third attached capture). My suggestion is either to have dynamic filtering, that is when you start typing your filter in the wizard, the corresponding catalog/schema display under the connection node without the need to type the complete name. If this is complicated technically, at least try to add a popup message that will open when the user type only part of the catalog name and click Finish to tell him/her that they must type the complete name. The last point to talk about here is that if users want to cancel the filter and list all catalogs/schemas in the connection, they need to delete the filter from the Package Filter field in the wizard and then click Finish again to list all catalog/schemas in the connection. Is it possible to add a button in the wizard, for example Remove Filter, that will remove the filter? This will be more obvious to the user. 8
278TDQ-5078">/<" shouldn't be allowed in the name of business rule in the business rule creation wizardWhen I tried to create a new business rule using the business rule creation wizard, I could use ">" in the business rule name (see the first attached capture). But after defining the rule in the second step in the wizard and trying to click Finish, I got an error message(see the second attached capture). When I didn't use this special character in the rule name, I could create the business rule without any problem. The user shouldn't be able to use special characters in the first step in the wizard when setting the rule name.8
279TDQ-8404jibx binding classes are missing in generated jar package tBRMS on macThis issue is found on mac, but not on windows. To verify on linux. It seems that the intermediate binding classes are not generated under the right folder, so that they are not included into the final jar. 8
280TDQ-5089IndexMigrator does not handle well subfolder of indexesI have tried to migrate the synonym under svn. I have got the following exception: Migrating all indexes in folder <.> REGENERATE: /home/scorreia/devel/svn_checkouts/tdq/branches/branch-5_0/org.talend.dataquality.data.resources/data/synonym/idx_address/idx_address_abbreviation_label_FR/. Exception in thread "main" java.io.FileNotFoundException: ./.svn (Is a directory) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.<init>(FileInputStream.java:138) at org.talend.dataquality.standardization.migration.IndexMigrator.copyFile(IndexMigrator.java:270) at org.talend.dataquality.standardization.migration.IndexMigrator.regenerate(IndexMigrator.java:206) at org.talend.dataquality.standardization.migration.IndexMigrator.run(IndexMigrator.java:138) at org.talend.dataquality.standardization.migration.IndexMigrator.main(IndexMigrator.java:304) 1
281TDQ-5090fix TUJ issue with tSynonym* componentstSynonymOutput_18428 and tSynonymSearch_18429 TUJ cannot be imported in a recent studio. fix these two TUJ. 3
282TDQ-5093Add an option in tSynonymSearch to do fuzzy searchAdd an option in the properties of the component that enables fuzzy search. By default, keep the same behavior as before. 8
283TDQ-5097Failed to generate report file in command linewhile I tried to generate a report via commandline, (executeReport -n label -p path) I got this error and no report file generated .. talend> java.lang.NullPointerException at org.talend.core.model.metadata.builder.connection.util.ConnectionSwitch.doSwitch(ConnectionSwitch.java:108) at org.talend.core.model.metadata.builder.database.JavaSqlFactory.getUsername(JavaSqlFactory.java:262) at org.talend.cwm.db.connection.ConnectionUtils.isConnectionAvailable(ConnectionUtils.java:286) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.validateReport(ReportDocGenerator.java:188) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:147) at org.talend.datacleansing.core.service.TDQReportService.executeReport(TDQReportService.java:63) at org.talend.commandline.command.CommandProcessor.executeReport(CommandProcessor.java:622) at org.talend.commandline.command.ExtensionCommandSwitch.caseExecuteReportCommand(ExtensionCommandSwitch.java:76 ) at org.talend.commandline.client.command.extension.AbstractExtensionCommandSwitch.doSwitch(AbstractExtensionComm andSwitch.java:35) at org.talend.commandline.command.CommandProcessorSwitch.caseExtensionCommand(CommandProcessorSwitch.java:161) at org.talend.commandline.client.util.CommandAbstractSwitch.doSwitch(CommandAbstractSwitch.java:70) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source)5
284TDQ-5101Import SQL file via import button, it show me that there is already oneimport a former build workspace, such as 4.2.x in the import wizard, I tried to select sql files to import in my local repository, there is only one -- "TEST_TOP" but it show me both of them are conflict ..5
285TDQ-5104Replace easymock library usage by powermockSee discussion on http://sandbox-network.talend.com/groups/rd/docs/automated-tests-junit-plugins-tools-mocks5
286TDQ-5105the related dependence tag didn't update after rename an item1.create a mysql connection named "M". 2.create a analysis named "A" and based on connection "M". 3.open "A" and rename to "B",then save it. 4.open the connection with "Text Editor". find the client tag did not update to name "B",it is still "A". so that this client dependcy of the connection is Proxy,may cause other issues. it seems that all items exist this problem,not only analysis-connection,I just test for report-analysis-connection. 8
287TDQ-5109when delete the generated reports, it is not convenience for the userwhen I delete more than one generated reports, it is not convenience for me I must confirm one by one8
288TDQ-5110extract the summary area of the report as sub-report in the studio- Extract the summary area of the report as sub-report in the studio - Investigate the customizer class loading problem in DQPortal app. - Modify parameters in DQ portal to adapt the JRXML,Test each of these jrxml on DQportal - Commit these jrxml to svn20
289TDQ-5116Remote project mode, read only user still can edit the editorI logged on a remote project with a read only user but I still can modify the resources.8
290TDQ-5117can not preview the view which named "columns" for db2 dbconnectionI have a view file which named "columns", try to preview it on repository, get errors. for db2dbconnection. should also make preview table correct for special name. 5
291TDQ-5118the tables and view can not show correctly for db2zos connection.1. create a db2zos dbconnection-- I just select db2zos type in the creation wizard, but connetion to a norminal db2 database. 2. try to check the tables and views. result: the tables and views not only show under its corresponding folders , but table also show under "Views" folder, and view also show under "Tables" folder. should not like this. no errors.5
292TDQ-5119the "execution status" should not display an error message when the analysis is not executed yetThere should be no message instead of the "Failure: null" message when the number of execution is 0. Or the number of executions should be > 0.5
293TDQ-5123the "Table/View Selection" dialog can not show the sub node of the dbconnection1. create a table rule analysis 2. click the link "select tables/views to analyze" in the pop-up dialog can not show the sub node of the dbconnection.8
294TDQ-5127Drag a node under analysis or report to any other place will throw NPEdrag a node under a analysis model --- "analyzed elements(..)" into another folder drag a node under a report model --- "Analyzes()" or "Generated Documents()" into another folder will throw an error java.lang.NullPointerException at org.talend.repository.localprovider.model.LocalRepositoryFactory.moveFolder(LocalRepositoryFactory.java:1183) at org.talend.core.repository.model.ProxyRepositoryFactory.moveFolder(ProxyRepositoryFactory.java:462) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.computePath(RepositoryNodeDorpAdapterAssistant.java:566) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.moveFolderRepNode(RepositoryNodeDorpAdapterAssistant.java:424) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.computeRepNodeType(RepositoryNodeDorpAdapterAssistant.java:222) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(RepositoryNodeDorpAdapterAssistant.java:158) at org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) at org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) at org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) at org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) at org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) at org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:258) at org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) at org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) at org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) at org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) at org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) 3
295TDQ-5128Delete a generated document manually and then try to open it in studio will get an errorafter execute the report file it will generate a document in my disk I delete this document manually, not via the studio the document node is still can be visible in studio while tried to open it, studio will throw error said: can not find file ... org.eclipse.core.internal.resources.ResourceException: Cannot create linked resource. Local location '(generated document path...)' does not exist. at org.eclipse.core.internal.resources.Resource.assertLinkRequirements(Resource.java:180) at org.eclipse.core.internal.resources.Resource.createLink(Resource.java:655) at org.eclipse.core.internal.resources.Resource.createLink(Resource.java:629) at org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.duRun(OpenItemEditorAction.java:145) at org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction$1.run(OpenItemEditorAction.java:118) at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:2592) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1740) at org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.run(OpenItemEditorAction.java:125) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.jface.window.Window.runEventLoop(Window.java:825) at org.eclipse.jface.window.Window.open(Window.java:801) at org.eclipse.ui.internal.views.log.EventDetailsDialog.open(EventDetailsDialog.java:176) at org.eclipse.ui.internal.views.log.EventDetailsDialogAction.run(EventDetailsDialogAction.java:98) at org.eclipse.ui.internal.views.log.LogView$15.doubleClick(LogView.java:536) at org.eclipse.jface.viewers.StructuredViewer$1.run(StructuredViewer.java:824) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.JFaceUtil$1.run(JFaceUtil.java:49) at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:175) at org.eclipse.jface.viewers.StructuredViewer.fireDoubleClick(StructuredViewer.java:822) at org.eclipse.jface.viewers.AbstractTreeViewer.handleDoubleSelect(AbstractTreeViewer.java:1421) at org.eclipse.jface.viewers.StructuredViewer$4.widgetDefaultSelected(StructuredViewer.java:1225) at org.eclipse.jface.util.OpenStrategy.fireDefaultSelectionEvent(OpenStrategy.java:238) at org.eclipse.jface.util.OpenStrategy.access$0(OpenStrategy.java:235) at org.eclipse.jface.util.OpenStrategy$1.handleEvent(OpenStrategy.java:296) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) 3
296TDQ-5129Junit for TDQ-4753 Write a Junit to test the changeset of http://talendforge.org/trac/top/changeset/813113
297TDQ-5130the analysis about file connection can not open after "edit schema"file connection is not export as context 1. create an analysis about a file connection. 2. right click the file connection -> edit schema, in the pop-up dialog select the "Guess Schema", click "ok" 3. reopen the analysis, can not open get error. 5
298TDQ-5132the wizard of creation a fileDelimited connection can not work well on toptry to create a file connection on top, on the wizard of preview column can not finished. ok on tdq.8
299TDQ-5133switch perspective is slowafter create a big data connection then switch respective from TDQ to TOS is slowly13
300TDQ-5137select view on the business rule analysis is invalid.select view on the business rule analysis is invalid.3
301TDQ-5138the selection for mdm connecton's columns is not correct.1. create a mdm connection. 2. try to create a column/columnset analysis. 3. refer to the pic, if I select a sub node of Product on the right pane, such as Id, seems other nodes-> features(sizes, colors) and stores also selected (not correct) 4. click ok, check in the analysis editor, not 'ID' and 'name' but all the sub nodes of 'Sizes'('Size'),'Colors'('Color') and 'Store'('Store') please refer to the pic. it should select the nodes correctly. (1). if select a root node, should select all its sub nodes. (2). if select a sub node which has no sub node, should select itself only.13
302TDQ-5139the analysis result and drill down doesn't work well for mdm column analysis1. create a mdm column analyis about 'Product' entity which contains "id" and "name" and "family" sub nodes. 2. have 3 records which id name family 1 product1 (not set) 2 product2 (not set) 3 product3 familyaa 3. select simple statistics indicators for the analysis for sql engine result: RowCount Null Distinct Unique Duplicate family 3 2 1 1 1 id 3 0 3 3 0 name 3 0 3 3 0 for java engine result : RowCount Null Distinct Unique Duplicate family 3 3 1 0 1 id 3 3 1 0 1 name 3 3 1 0 1 issue 1: different for sql and java engine. issue2 under java engine try to "view row" on result page, get error. we should have correct analyze result and can drill down correctly for "view row" and "view values" correctly.8
303TDQ-5140DQ Portal Install - holds hardcoded IP not machine nameWhen you run the DQ Portal install, even if you supply in "Localhost" for all machine details it actually saves to the repository the hardcoded machine IP. This means if the machine IP changes the DQ portal fails, this is bad pratice and should use the machine name so dns etc resolves. For now this can be worked around by removing the fixed IP address from tables: update SBI_VIEWPOINTS update SBI_REMEMBER_ME update SBI_LOV set LOV_PROVIDER update SBI_ENGINES replacing for exmaple: http://127.23.36.35:8580/SpagoBIBirtReportEngine/BirtReportServlet with http://localhost:8580/SpagoBIBirtReportEngine/BirtReportServlet20
304TDQ-5143Checking datamart will get error on Dev environment console1.create a report and select a column analysis with simple indicators. 2.for the datamart,I select the default "HSQL". 3.click "check",will get a successfull infor dialog.It is ok. But get error on dev environment console(it has relation with Mysql?),and there is not error on studio log viewer.8
305TDQ-5144use installer install the DQPortal on oracle, there have some problemsuse installer install the DQPortal on oracle, open 'KPI' and 'indicators' from menu 'dashboard', the page have no content and after a while will throw a TimeOut exception, if open 'KPI' and 'indicators' some times, after a while the web server will throw OutOfMemoryErr; if import the tdqportal database by hand will not have such problems there have three computer to reproduce this problem: 1. DQPortal install computer(install DQPortal on this computer): windows xp 2. Oracle database computer(the "tdqportal" and "talend_dq" database installed on this computer): windows xp 3. Client computer: Ubuntu 11.10 + Firefox 11.0, use this computer to access the DQPortal if access the DQPortal from a windows system by Firefox, it's ok2
306TDQ-5146find some issue about report filefind some issue about report: (1). for report about overview(connection/schema/catalog) analysis , the summary of report can not get the table/view filter (2). for "Presentation Settings"(in report editor),set some value as "Page Number", Result:"Page 1 of2", there should be a space between 'of' and '2' (3). for report about column analysis, if columns from a catalog, for schema's values show nothing, when columns from schema, catalog's value show 'N/A(TDQ)', we should unify it. also for other analysis's summary. (4). column set analyzed more than one column, the summary of report show only one column. should we show this, how about if set 100 columns in the column set? (5). for content compare basic lose the "anaysis" in summary of report compare to the evolution. (6). for functional analysis report-- evolution, can not seem the data aixs, just the time one. (7). for schema report, also set catalog's value as schema's value, should be not set or N/A(TDQ)---basic (8). No value on vertical axis of simple analysis chart with basic type. (9). SUMMARY OF REPORT:-->SUMMARY OF ANALYSIS:13
307TDQ-5149import the file under Exchange, no dialog pop-up to show the result.1. try to import a file under Exchange, indicator,regex or sql. there is no dialog pop up to show the result, redo this function, there will be one. why the first time do this no inform.5
308TDQ-5151TalenD installation problemWhen installing TalenD getting following (see attachment) errors thus the Talend is not installed. We need TalenD only for data cleansing purposes (data deduplication). 8
309TDQ-5154update DQ portal jrxml file with those in the DQ Portal web applicationcheckout http://talendforge.org/svn/dqportal/trunk/org.talend.dqportal.configuration/ Compare each jrxml file in reports/ ├── column │   ├── b01_column_basic.jrxml │   ├── b02_column_evolution.jrxml │   ├── p01_column_basic.jrxml │   ├── p02_column_evolution.jrxml │   ├── p03_column_basic_dq_rules.jrxml │   ├── p04_column_dq_rules_evolution.jrxml │   ├── README.txt │   └── report_01.jrxml ├── dashboard_report │   ├── pri01_potential_pk.jrxml │   ├── pro01_orphan.jrxml │   ├── pro02_tables_no_fk.jrxml │   └── pro03_tables_no_pk.jrxml ├── indicator_reference.ods ├── match │   ├── p05_match_basic.jrxml │   └── p06_match_evolution.jrxml └── overview ├── p03_overview_basic.jrxml ├── p04_overview_evolution.jrxml └── po04_index_collmn.jrxml with the current jrxml templates available in the DQ Portal web application. Replace the jrxml file of the svn folder by those coming from the DQ portal web application. Commit the changes. 5
310TDQ-5155Change the look&feel of all these reports and commitWe'll keep track of all changes by using svn for these reports. 20
311TDQ-5156Unify Oracle and MySQL reports queriesCompare the files on svn with the files from the Oracle configuration of the DQ portal. Change the queries so that they can be executed on both MySQL and Oracle. The jrxml files should be generic enough to be compatible with both databases. 13
312TDQ-5157update the MySQL DQ Portal configuration dump with the new jrxml filesNULL5
313TDQ-5158Use HSQL database for the DQ Portal configuration- Use HSQL instead of MySQL or Oracle for the DQ Portal configuration (tdqportal database). - Remove the related configuration pages from the installer. - Remove the installer tasks related to the dumps of Oracle and MySQL. - Add an installer task for the configuration of the HSQL database.13
314TDQ-5180duplicate an overview analysis with table/view filters, the duplicated analysis don't contain table/view filtersNULL5
315TDQ-5181for the job generated by the pattern "generate an ETL job to handle rows" can not run successfully.1. create a column/column set analysis about db2 connection. 2. add pattern to the analysis, run in java engine. 3. in result page, right click the pattern, get menu "generate an ETL job to handle rows" run the job failed. 8
316TDQ-5182for the report file can not show threshold correctly.1. for report about column set analysis lose header, both basic and evolution. 2. for dq rule analysis when data out of threshold, lost some data show 3. for the frequency of indicator, when out of threshold, the color is not right, should be red. 4. the summary info should not display "null"8
317TDQ-5183new line character issue with DQ rule component in windowsIn window, the generated query usually contains several lines. see job item. {code} <elementParameter field="MEMO_SQL" name="QUERY" value="&quot;SELECT `customer_id` FROM `tbi`.`customer` &#xA; WHERE (( customer_id>2500&#xD;&#xA; ))&quot;"/> {code} The new line characters from DQ Rule are presented as "&#xD ;&#xA ;", which correspond to "\r\n". pb1: the "\n" character must be replaced by SPACE_SYMBOL, but not EMPTY_STRING. pb2: the "\r" character must be replaced at the same time as well as "\n". otherwise, it will be included in the generate job like the following and will cause compile error: {code} String dbquery_tMySQLValidRows_1 = "SELECT `customer_id` FROM `tbi`.`customer` WHERE (( customer_id>2500 ))"; {code} 2
318TDQ-5184the backcolor is incorrectlook at the attachment screenshot about the dropdown list in image "bg2.png", can prefer to the dropdown list in image "bg1.png"1
319TDQ-5185Delete analysis and report at the same time, the analysis is still under analysis nodecreate an analysis and report, report depends on analysis select these two items at the same time, delete them then can see the analysis and report in recycle bin but there is still one analysis under analyses node, take a look at the screen shot if do some operations on this analysis will get errors5
320TDQ-5186In seme way, don't check "force delete" still can delete the depended itemcreate an analysis and a report, the report depends on this analysis delete this analysis into recycle bin, keep report in repository select them at the same time and do delete operation first, it will pop up a dialog tell me that, there is dependency between these two items do NOT check the "force delete", click on ok button then it will pop up another dialog to ask me if I will delete the item forever click yes, it will delete the analysis and report goes into recycle bin...5
321TDQ-5187DQ datamart URL is wrong I have such a JDBC URL after installing the newest version DQ Portal jdbc:mysql://192.168.0.199:3306/talend_dq69227 Why? PS: Make sure that the management console of datasources must be take effect in DQ portal.2
322TDQ-5189use dynamic pattern list in tMultiPatternCheckCurrently regexes are hard coded. They must be retrieved from the DQ repository view. Use the list of patterns as it is done in tPatternCheck. Beware that the job must be able to run without accessing the patterns in the dq repository view (just like the tPatternCheck component). 5
323TDQ-5190issues for db2 zos connection.1. create a db2 zos connection, the first time the schema will not show for which no tables and views(after reload will show all). 2. for the db2zos connection, there is one schema value is different to a db2 connection. the SYSIBM schema, for db2zos have tables and view, but for db2 connection there is no tables. issue 3 create a db2/db2zos connection with schema filter, schema show well, reload database list will show all the schemas. 8
324TDQ-5191column set analyzed report can not show all the column namesin the summary of analysis, should show all the column names like "xxx,xxx,xxx" note: both studio and dqportal need to modify5
325TDQ-5192when there are more than one analyses in a report, the page number display is incorrectset report as the attchment screenshot and the error report as "column-20120418-1413-00051.pdf"8
326TDQ-5199the table chart for oracle data and oracle datamart is not correctly in report1. create a column anlaysis about oracle connection. 2. just select simple statistics. 3. try to generate with oracle datamart. check the result as pic attached. all the indicator show in one table chart. issue 2. now we set the result value above the chart, but sometimes the value can not show fully, as pic(if data is larger, even half of the data will be covered) issue 3. for the summary of a report, value for Catalog and Schema, why when use hsql and mysql, it is ok, when datamart is oracle, one of them will set as 'null' issue 4. in report why the "pattern" in table chart show as 'Regular Expression' issue 5. when i create an analysis with TextStatistics indicators, the dqportal of column basic can not find it. also should support the other type indicators8
327TDQ-5200Should remove client dependences in connection when all columns are deleted in analysis1.crate a mysql connection 2.crate an anlysis based on this connection,select one or more colums,save this analysis. 3.delete all columns on this analysis editor,save it. 4.check the connection file,the tag 'client' about this analysis still exsit,should be removed. It seems that this connection in memory is ok(means the related dependences are removed),but fail to persistence. Recently,I have reported some bug about dependeces,might has same reason,please check.13
328TDQ-5205In result of tRuleSurvivorship component, each master record should also have a GID NULL2
329TDQ-5211Backport TDQ-4870 to branch 5.0In branch 5.0, there is only one sub-report for column set report that need to be import/export.2
330TDQ-5212PostgreSQL compare between local and remote failedwhile tried to compare a postgreSQL connection between local and remote in studio got a "check connection failed:null" error java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.cwm.compare.ui.actions.PopComparisonUIAction.run(PopComparisonUIAction.java:77) at org.talend.cwm.compare.ui.actions.SubelementCompareAction.run(SubelementCompareAction.java:111) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.performCompareAction(CompareModelContentMergeViewer.java:334) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.access$1(CompareModelContentMergeViewer.java:306) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer$CompareMouseListener.mouseDoubleClick(CompareModelContentMergeViewer.java:291) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) Caused by: java.lang.NullPointerException at org.talend.cwm.compare.ui.actions.PopComparisonUIAction$1.run(PopComparisonUIAction.java:67) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 33 more Root exception: java.lang.NullPointerException at org.talend.cwm.compare.ui.actions.PopComparisonUIAction$1.run(PopComparisonUIAction.java:67) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.cwm.compare.ui.actions.PopComparisonUIAction.run(PopComparisonUIAction.java:77) at org.talend.cwm.compare.ui.actions.SubelementCompareAction.run(SubelementCompareAction.java:111) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.performCompareAction(CompareModelContentMergeViewer.java:334) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.access$1(CompareModelContentMergeViewer.java:306) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer$CompareMouseListener.mouseDoubleClick(CompareModelContentMergeViewer.java:291) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) 8
331TDQ-5213report about phone number indicator can not generated successfully.1. create an analysis about phone number indicators. 2. try to generate a report about the analysis file with basic type, get error. evolution is ok now. 5
332TDQ-5215Create a User defined indicator that implements the Benford lawSee TDQ-5076 Create a java UDI and add also SQL templates when possible. 8
333TDQ-5220Wrong warning shellSet the parent shell for the warning dialog. 3
334TDQ-5222Fail to view value with distinct indicator in columnSet analysis 1.create a column set analysis with two cloumns. 2.run this analysis. 3.turn to result page,drill down with "View values",can not get the query result,but an error dialog.2
335TDQ-5223Create version 5.1.0 in Babili and populate itNULL2
336TDQ-5227Backport changeset of TDQ-2699 from trunk to branch 5.0 and 4.2NULL3
337TDQ-5232some wizard of "Match Data Job" and "Deduplicate Data Job" are not correct in cheat sheet1. try to create "Match Data Job" and "Deduplicate Data Job" follow the wizard of in cheat sheets 2. in the wizard when select "Choose existing metadata from Repository" the pop-up dialog can not show the existing metadata, but some other dialog. 5
338TDQ-5233support long varchar on DB2Currently several indicators are not support on long varchar type on DB2 database. They should be supported as varchar type. See more on TDQ-2699 , contact qiongli to get more information. 5
339TDQ-5234Pattern processing should be coherent across pattern analysis, Pattern Test View and componentsAt the moment, Pattern analysis uses {code}Pattern.compile("regex").matcher("input").find(){code} But Pattern Test View and components use {code}Pattern.compile("regex").matcher("input").matches(){code} or {code}Pattern.matches("regex", "input"){code} (the 2nd and the 3rd are equivalent) Following the discussion with scorreia, the first one is more flexible, because the other 2 methods try to match the entire string even there is no "^" "$" signs, which narrows the possibility to match parts of a string. Besides, in SQL mode of Pattern Test View, the databases apply regex like in the first way.2
340TDQ-5238Incorrect primary key informationThe information about the PK is not correct. See screen capture. The "primary keys" field should list the columns used as key. 5
341TDQ-5240Business rule analysis doesn't get match/nonmatch chart, while add the rule by click the icon in analysis editorwhile add the rule to a table analysis by click the icon in analysis editor doesn't get the chart of match/nonmatch3
342TDQ-5241run analysis get error for 'time' type of column1. create a column analysis with time type of column 2. select all indicators can run well for this column. 3. after run get error.(see error in details tab) 4. for db2 column seems all the Advanced can not work well errors like below. (2012-04-26 11:27:53,953 ERROR org.talend.dq.analysis.ColumnAnalysisSqlExecutor - Query not executed for indicator: "Week Low Frequency Table" SQL query: SELECT YEAR("COLUMNTIME") , QUARTER("COLUMNTIME") , MONTH("COLUMNTIME") , WEEK("COLUMNTIME"), COUNT(*) c FROM "TALEND"."FORTEST" t GROUP BY YEAR("COLUMNTIME") , QUARTER("COLUMNTIME") , MONTH("COLUMNTIME") , WEEK("COLUMNTIME") ORDER BY c ASC FETCH FIRST 10 ROWS ONLY). we should control well for this.8
343TDQ-5242report doesn't show basic chart while it contains both basic and evolution type templatewhile a report contains both basic and evolution type template the generated report file only show the evolution template, doesn't show the basic type8
344TDQ-5245for some column analysis can not turn to result page correctly1. create a column analysis about oracle dbconnection. 2. select three columns-- date, varchar,number. 3. select all the indicators for the three columns. run get error for the last log item, no pic show. turn to result page, get same errors, no any pic show. note??you can also reproduce it by seect 15 column, and select all the indicators, run,?delete one column in the first editor page, turn to second page, also get error(refer to second error in Details tab) most of time can not reproduce(reproduced, do some more testing, re-open studio, can not get error). I think we'd better check it as error log. Thanks13
345TDQ-5246for mdm connection can not show the column name on the "Select patter to filter the data of table"1. create a column set analysis about mdm connection. 2. add a pattern to one column. 3. run, turn to result page, click the Data->Filter Data , in the pop-up dialog, can not see the column name. refer to the pic.3
346TDQ-5247add pattern to the column lead to the indicator on the column disappear.1. create a column analysis. 2. add some indicators to the column. 3. try to add pattern to the column by click the "add pattern" icon. result indicators(both sys and UDI) for this column disappear. note if I drag pattern will not cause this. 1
347TDQ-5248the report(evolution) result seems not correct for those migrate from lower version1. create some report file and generate with mysql datamart on 5.0.2(project name is 'test02') 2. migrate both report file and datamart to 5.1.0 (the new project name is 'test510') 3. re-generate the report file with evolution type. result just one point show. in my opinion this is not correct.13
348TDQ-5249Tell user which analyes are impacted.Tell users which analyses are impacted when relaoding.8
349TDQ-5250When I cancel the delete action, the report should be back to the original position. NOTE: "Fail to delete forever dependencies" is not necessary, remove it.5
350TDQ-5251remove shadow in chartsSince the upgrade of the jfreechart library, shadows appeared in the bar charts. Please, remove these shadows as they make the results harder to read. See attached picture5
351TDQ-5252Remove scrollbars when not necessaryThe scrollbars should not appears when there not several lines. See picture. 2
352TDQ-5253Selection lost in UDI selection windowCreate a column analysis, add a UDI reopen the UDI selection window: The previously selected UDI is not selected anymore!2
353TDQ-5254The links in welcome page of Talend open studio for DQ version failed to be functional.The links are not work, e.g: * Installation guide * Talend Open Studio for Data Quality user guide It seems that the "target" attribute in <a tag is the root cause... This one works: <a href="http://talendforge.org/wiki/doku.php?id=doc:installation_guide" >Installation guide</a> This one fails: <a href="http://talendforge.org/wiki/doku.php?id=doc:installation_guide" target ="showInstallationGuide">Installation guide</a> 3
354TDQ-5255The HTML XML EXCEL and RTF format are not satisfactory for the new look and feel.Apply all to both studio and dqportal application.8
355TDQ-5256Migration lose the Norminal and Time correlation analysisTry to do the migration by import button. For 423 and 502 will lose the Norminal and Time correlation analysis.8
356TDQ-5257redundant folder after migrating 413 source fileTry to do the migration by import button. for the source file from 413 show some redundant folder5
357TDQ-5258Analysis in a folder cannnot be opened after migrationTry to do the migration by import button. - Create an analysis which profiling file connection. - Create a new foler named "file connection" in analysis root folder. - Put this analysis in to the new foler. - Migrate it. - The analysis is out of folder and can not open Note: migration from 413, for another versions ok.8
358TDQ-5259Migrate file from 401, just can show some of analysis and none report showTry to do the migration by import button. Migrate file from 401, just can show some of analysis and none report show, and show a redundant folder for UDI, refer to pic (on TDQ-5221). 13
359TDQ-5260for the file from 413, the mdm connection lost, all the analysis can not openTry to do migration by logon window. for the file from 413, the mdm connection lost, all the analysis can not open.8
360TDQ-5276for dqportal there is some issue need to fix1. the header of "Pat_matching evolution" and "Simple stats evolution" should be "Table.column", lose ".column" 2. for column set (both basic and evolution), the background color of "Summary of Analysis" is different to others. 3. for "Redundancy analysis"->basic and evolution even if I choose 'no' for header, it still show in result. 4. for "potential primary keys": the "Potential Primary keys" title should be near with "summary of analysis" 5. the Orpan tables: the summary of analysis shows catalog/schema, below inform show not only about the certain catalog/schema. should change this. 6. for title Tables without pK/Fk: just show "TABLES WITHOUT", lose 'PK/FK' the information show "CATALOG.SCHEMA:" we'd better leave a big space with "summary of analysis"(for FK template no this inform) 7. for "Column size analysis", the header and other inform are not same width. 8. the oracle datamart dqportal tested for example on 24/4, some of template can not show the result, but I change system time to 25th/4, can all show correctly. why? 5
361TDQ-5279for the view row/values on Unique count is not correct for int type about fileConnection 1. create a file connection. 2. create a column analysis about the connection. 3. try to view row/values for 'Unique count' on a int type column--try this with the Unique and Distinct result is different columns. can get result, but the result number is different with unique count, but same with distinct count. 8
362TDQ-5280Issues found when i save BRMS metadata from component to repositoryThe issues are mainly about the text handling for URLs, class/module names etc. for example: In the component configuration, quotes are removed for "org.talend.bank.LoanSimulator" after saving metadata, so the generated code contains "rg.talend.bank.LoanSimulato.class" 13
363TDQ-5285select a connection which has been physical deleted from the connection list on the analysis editor, throw NPEjava.lang.NullPointerException at org.talend.dataprofiler.core.ui.action.actions.ChangeConnectionAction.<init>(ChangeConnectionAction.java:99) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.callChangeConnectionAction(AbstractPagePart.java:240) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.access$0(AbstractPagePart.java:238) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$1.widgetSelected(AbstractPagePart.java:223) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1061) at org.eclipse.nebula.widgets.tablecombo.TableCombo.tableEvent(TableCombo.java:1339) at org.eclipse.nebula.widgets.tablecombo.TableCombo.access$4(TableCombo.java:1306) at org.eclipse.nebula.widgets.tablecombo.TableCombo$1.handleEvent(TableCombo.java:179) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 8
364TDQ-5286"Run" button disabled when launch a report 1.Create a mysql db 2.Create a column analysis 3.Create a report and select this analysis Right click this report, choose Generate Jobs.Choose Launch a report menu. 4.After turn to the job page ,click the button"Run",but this button disabled .can refer to the "rundisable.png";5
365TDQ-5287Fix Java regex problemThe java regex of the "Contains numbers" pattern should read '\d' instead of '^\*\d+\D\*$'5
366TDQ-5288change the connection of Functional Dependency Analysis on Postgresql, throw NPEjava.lang.NullPointerException at org.talend.dataprofiler.core.ui.editor.analysis.ColumnDependencyMasterDetailsPage.validator(ColumnDependencyMasterDetailsPage.java:359) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnDependencyMasterDetailsPage.canSave(ColumnDependencyMasterDetailsPage.java:206) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.doSave(AbstractAnalysisMetadataPage.java:150) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.callChangeConnectionAction(AbstractPagePart.java:274) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.access$0(AbstractPagePart.java:238) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$1.widgetSelected(AbstractPagePart.java:223) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1061) at org.eclipse.nebula.widgets.tablecombo.TableCombo.tableEvent(TableCombo.java:1339) at org.eclipse.nebula.widgets.tablecombo.TableCombo.access$4(TableCombo.java:1306) at org.eclipse.nebula.widgets.tablecombo.TableCombo$1.handleEvent(TableCombo.java:179) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) org.eclipse.swt.SWTException: Failed to execute runnable (org.eclipse.core.runtime.AssertionFailedException: null argument:) at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:3515) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3164) at org.eclipse.jface.operation.ModalContext$ModalContextThread.block(ModalContext.java:173) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:388) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:38) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.callChangeConnectionAction(AbstractPagePart.java:258) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.access$0(AbstractPagePart.java:238) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$1.widgetSelected(AbstractPagePart.java:223) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1061) at org.eclipse.nebula.widgets.tablecombo.TableCombo.tableEvent(TableCombo.java:1339) at org.eclipse.nebula.widgets.tablecombo.TableCombo.access$4(TableCombo.java:1306) at org.eclipse.nebula.widgets.tablecombo.TableCombo$1.handleEvent(TableCombo.java:179) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: org.eclipse.core.runtime.AssertionFailedException: null argument: at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:85) at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:73) at org.eclipse.jface.viewers.StructuredViewer.assertElementsNotNull(StructuredViewer.java:595) at org.eclipse.jface.viewers.StructuredViewer.getRawChildren(StructuredViewer.java:990) at org.eclipse.jface.viewers.ColumnViewer.getRawChildren(ColumnViewer.java:703) at org.eclipse.jface.viewers.AbstractTableViewer.getRawChildren(AbstractTableViewer.java:1087) at org.eclipse.jface.viewers.StructuredViewer.getFilteredChildren(StructuredViewer.java:896) at org.eclipse.jface.viewers.StructuredViewer.getSortedChildren(StructuredViewer.java:1046) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefreshAll(AbstractTableViewer.java:701) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:649) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:636) at org.eclipse.jface.viewers.AbstractTableViewer$2.run(AbstractTableViewer.java:592) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1422) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1383) at org.eclipse.jface.viewers.AbstractTableViewer.inputChanged(AbstractTableViewer.java:590) at org.eclipse.jface.viewers.ContentViewer.setInput(ContentViewer.java:274) at org.eclipse.jface.viewers.StructuredViewer.setInput(StructuredViewer.java:1664) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnCompareTreeViewer.updateModelViewer(AnalysisColumnCompareTreeViewer.java:734) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$2$1.run(AbstractPagePart.java:250) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 44 more 5
367TDQ-5297open a window where the user can select the report he'd like to mass edit the datamart settingsThe problem comes from TDQ-4774 , it may be problematic for users having a lot of reports when he/she wants to edit the datamart settings. In the preference page, add a button, when this button is clicked, opening a window where the user can select the report he'd like to mass edit the datamart settings.13
368TDQ-5298remove dependency org.talend.repository.mdm from org.talend.dataprofiler.coreOn feature TDQ-1887 , this plugin is required. But now we won't need it any more. remove it from the dependency list and from feature.2
369TDQ-5299Enable the "Create connection" menu in TOS for DQThe "Create connection" from a Catalog/schema item is currently only available in the Entreprise edition. Enable this menu in TOS for DQ too. 3
370TDQ-5314Remove the unecessary de-duplicate analysis creation wizard When the count of #Match is greater than the row count in DQ rule analysis, there is a context menu: "simple analysis with join condition columns", click it, there will be wizard to create an analysis. TODO: - Text "simple analysis with join condition columns" should be "analyze duplicates" - Wizard is not necessary, just creating an analysis with row count and duplicate count indicator completely.13
371TDQ-5315Add this link to studio bookmarkAdd this link to studio bookmark: http://jira.talendforge.org/secure/IssueNavigator.jspa?mode=hide&requestId=122781
372TDQ-5316Missing table size chart in overview reportThe chart giving the repartition of the table sizes is missing in the new overview report. See attached picture or TDQ-3397 user story: for user, from the pie chart, can see the main tables(first 5 tables) which have more rows, and the other tables with a "Others" to do a description 8
373TDQ-5319report file can not generate succesfully which have set logo1. create a report file set logon generate the report file, can not successfully get inform if the pic for the logo is in a path which contains chinese, will also get error5
374TDQ-5320Error running a report with phone number indicatorsCreate an analysis with all phone number statistics and java engine Create a report with a mysql storage. Execute the report. -> it fails: java.lang.NullPointerException at net.sf.jasperreports.engine.JRAbstractExporter.setJasperPrint(JRAbstractExporter.java:799) at net.sf.jasperreports.engine.JRAbstractExporter.setInput(JRAbstractExporter.java:867) at net.sf.jasperreports.engine.export.JRPdfExporter.exportReport(JRPdfExporter.java:260) at org.talend.dataquality.reporting.JasperReportBuilder.run(JasperReportBuilder.java:277) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateReport(ReportDocGenerator.java:523) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateDoc(ReportDocGenerator.java:257) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:164) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:117) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) 2
375TDQ-5321Several menus don't work in QBEIn the DQ Portal, go into QBE and run a query. Click on the save button. -> catalina.out it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: KO it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: The error root cause is: KO it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: The error root cause stack trace is: it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: The error full stack trace is: it.eng.spagobi.utilities.engines.SpagoBIEngineServiceException: KO at it.eng.spagobi.engines.qbe.services.core.catalogue.SaveAnalysisStateAction.service(SaveAnalysisStateAction.java:94) at it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) at it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) at it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:488) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at it.eng.spagobi.utilities.filters.SpagoBIAccessFilter.doFilter(SpagoBIAccessFilter.java:200) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at it.eng.spagobi.utilities.filters.EngineCheckSessionFilter.doFilter(EngineCheckSessionFilter.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:679) 8
376TDQ-5327Rename "Po05 Column wrang size.jrmxl" to "Po05 Column size.jrxml"Rename the report: ("wrang" is not an English word. Remove it) See pic.2
377TDQ-5328No column size analysis is never available in DQ portalExecute textual analyses in the studio (text indicators). Go in the dq portal and try to execute the "column size analysis" report. The list is always empty. There is no way to do a column size analysis. See pic. 3
378TDQ-5329Eclipse File association does not work anymore with the content of the DQ repository viewI used to go in the preference page and add a file association so that all *.pdf files are open with okular (linux pdf viewer). Now, when I do that, it is not taken into account. The double click on a generated pdf report is opened with another tool. (Note: the file association still work with jrxml file)13
379TDQ-5330Configuration wizard of tMatchGroup does not work if it is used after tRecordMatchingcf attached job13
380TDQ-5334migrate the file from one svn server to another with Repository manager can not logon the new project successfully1. create a remote project with server 1(svn and tac both on server1) 2. try to use Repository manager(1.1.0) to migrate the file to server 2(same tac version). 3. I just migrate dbconnections, analysis and indicator and patterns. try to logon the project on server 2. the Libraries can not initialized successfully. check the svn folder just indicator and pattern show refer to pic attached.13
381TDQ-5341import pattern from exchange, the folder is incorrectimport a pattern in exchange, for eg: FR Phone Number (parenthesis allowed) the folder will be ... take a look at the screen shot.8
382TDQ-5342Change the Display of the user defined jrxml path in the report editorThe display of the path should not be the full relative path. It should be the same display as in the repository view. See pic8
383TDQ-5343for try to add a more table to table analysis, the original rule for the table lost1. create a table rule analysis, add a table and a rule. 2. try to add another table to the table analysis by click the link "Select table/views to analyze" result: the second table added, but the rule have been added for the first table lose.8
384TDQ-5346file connection with context, set the first line as columns name -- failed to find the value of which one is set to be headercreate a file connection with context if set the first line as the columns name, while run analysis, failed to convert data java.lang.NumberFormatException: For input string: "context.a2_Header" at java.lang.NumberFormatException.forInputString(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at org.talend.dq.indicators.DelimitedFileIndicatorEvaluator.executeSqlQuery(DelimitedFileIndicatorEvaluator.java:121) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:121) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:181) at org.talend.dq.analysis.DelimitedFileAnalysisExecutor.runAnalysis(DelimitedFileAnalysisExecutor.java:67) at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:111) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:154) at org.talend.dataprofiler.core.ui.action.actions.AnalysisExecutorThread.run(AnalysisExecutorThread.java:86) at java.lang.Thread.run(Unknown Source) 5
385TDQ-5356when export/import an report file which depend on JRXML template can not show the dependency inforcorrectly.1. try to export/import report file. 2. uncheck the jrxml file which the report file depend on. check the inform information, it is not correct. should show the jrxml template name.5
386TDQ-5357"Frequency Table" indicator is same to "Year Frequency Table" when applying on "Time" type?For the DB2 columns which has "Time" data type, the "Frequency Table" indicator is same to "Year Frequency Table" when applying on "Time" type, that's wrong.8
387TDQ-5359do empty recycle bin under DI get error when db depend by analysis1. create dbconnection, file connection, mdm connection. 2. create column analysis about these connections. 3. delete dbconnection to Recycle bin. 4. turn to DI perspective, try to delete the dbconnection by right click it, work well-- get inform dbconnection is depended . try to "Empty recycle bin", only one inform (The selected element(s) will be deleted forever (cannot be retrieved). Continue anyway?), click yes get error; there should be inform information : some items is depended by others, can not deleted. issue 2: re-do step 3 and 4, for file and mdm connection, connections will be deleted forever, analysis unavailable for issue 2 also reproduce on branch 4.2 and 5.013
388TDQ-5361reload column list function will multiply the columns number1. select a table unfold to columns, check the column show correctly. 2. reload column list, the number will be twice. 3. redo reload the number will be 3 times of the original ones. 4. create a column analysis by right click the table the rows will be 3 times in the analysis.3
389TDQ-5362column/column set analysis editor can not be shown correctly after switching the context of file connection1. create a column/column set analysis about file connection which has been export as context. 2. do "switch context" for the file connection, select a different schema file to check the switch function. but nothing changed in the Repository. should we do some reload when switching? then, I have to right click "Metadata"->edit schema to get the changes. 4. try to open column and column set analysis both get error. for column analysis can not shot the editor correctly. refer to pic, for column set in the editor show "Could not open the editor: An unexpected exception was thrown." because the schema have change to different, so analysis can be lost their items but should be open correctly. if change to a same schema file, the analysis should work well, right(I didn't test it on this bug)? 13
390TDQ-5368Dependency handling has some problem when import by buttonissue 1: 1).import some items by button. 2).there is error message about missing dependcy(see detail with pic1),but the related analysis of report "columnJTxml" is in the tree,it is "column" analysis. issue2: 1).uncheck a reprot "column".(see detail with pic2,pic3) 2).the related analysis "column" and the related connection "oracle" are unchecked.so that, has a another error message about missing "oracle" connection.13
391TDQ-5369preview a table in sybase connection, will throw an errorIn repository, right click on a table and do preview operation will get this error org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.IllegalArgumentException: Index out of bounds) at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) Caused by: java.lang.IllegalArgumentException: Index out of bounds at org.eclipse.swt.SWT.error(SWT.java:4064) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.SWT.error(SWT.java:3969) at org.eclipse.swt.custom.StyledText.getOffsetAtLine(StyledText.java:4357) at net.sourceforge.sqlexplorer.plugin.editors.SQLEditor.setCursorPosition(SQLEditor.java:1017) at net.sourceforge.sqlexplorer.sqlpanel.AbstractSQLExecution$1.run(AbstractSQLExecution.java:255) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 22 more 8
392TDQ-5370some indicators are disabled for "text" data type in Mysql1.create an anlysis with "text" data type of Mysql. 2.some indicators are grayed.(.e.g,just Row Indcator is enable for simple statistic indicator) 8
393TDQ-5376open about 60 analysis, get no more handles error.have about 60 analysis, and open one by one, keep them open, at last get error, refer to the attached log.13
394TDQ-5381unrecognized median indicator definitionSee attached picture.8
395TDQ-5382Export babili translations into trunk of SVNNULL2
396TDQ-5384Rule name of tRuleSurvivorship are restrictedtRuleSurvivorship generates drools resources into DI repository, the file name is the same as that of the rule and the type is TDQFileItem. If i create a rule named "1_FirstRule", it worked before, but now it is not valid any more according to the file name regex during the creation. 13
397TDQ-5386select mysql ,orale and hsql as report db, generate report file is disabledMessage:2012-05-17 10:48:13,359 ERROR org.talend.dq.persistence.DatabasePersistence - org.hibernate.exception.SQLGrammarException: Cannot open connection Exception Stack Trace:org.hibernate.exception.GenericJDBCException: Cannot open connection at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103) at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29) at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:420) at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144) at org.hibernate.jdbc.JDBCContext.connection(JDBCContext.java:119) at org.hibernate.transaction.JDBCTransaction.begin(JDBCTransaction.java:57) at org.hibernate.impl.SessionImpl.beginTransaction(SessionImpl.java:1326) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.hibernate.context.ThreadLocalSessionContext$TransactionProtectionWrapper.invoke(ThreadLocalSessionContext.java:301) at $Proxy29.beginTransaction(Unknown Source) at org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:120) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.historizeData(ReportDocGenerator.java:310) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:159) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:117) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException: Listener refused the connection with the following error: ORA-12505, TNS:listener does not currently know of SID given in connect descriptor The Connection descriptor used by the client was: 192.168.30.87:1521:rootroot at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:261) at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:387) at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:441) at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:165) at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35) at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:801) at java.sql.DriverManager.getConnection(Unknown Source) at java.sql.DriverManager.getConnection(Unknown Source) at org.hibernate.connection.DriverManagerConnectionProvider.getConnection(DriverManagerConnectionProvider.java:110) at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:417) ... 15 more2
398TDQ-5387unselected columns be added to the analysis when use Column Selection Dialog to select columnsNULL5
399TDQ-5388when use the wizard to create analysis, the created one should be the "saved" statuswhen use the three menus(look at the screenshot) to create analysis, the created one should be saved status(use the other menus created is saved status)5
400TDQ-5389Test source file cheat sheet failedMessage:The action could not be run because an instance of the class 'org.talend.dataprofiler.core.sql.AddSqlFileAction' could not be created. Exception Stack Trace: java.lang.IllegalAccessException: Class org.eclipse.ui.internal.cheatsheets.ActionRunner can not access a member of class org.talend.dataprofiler.core.sql.AddSqlFileAction with modifiers "private" at sun.reflect.Reflection.ensureMemberAccess(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.ui.internal.cheatsheets.ActionRunner.runAction(ActionRunner.java:50) at org.eclipse.ui.internal.cheatsheets.data.Action.execute(Action.java:100) at org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:506) at org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:501) at org.eclipse.ui.internal.cheatsheets.views.CheatSheetViewer.runPerformExecutable(CheatSheetViewer.java:1046) at org.eclipse.ui.internal.cheatsheets.views.CoreItem$1.linkActivated(CoreItem.java:89) at org.eclipse.ui.forms.widgets.AbstractHyperlink.handleActivate(AbstractHyperlink.java:233) at org.eclipse.ui.forms.widgets.ImageHyperlink.handleActivate(ImageHyperlink.java:199) at org.eclipse.ui.forms.widgets.AbstractHyperlink.handleMouseUp(AbstractHyperlink.java:327) at org.eclipse.ui.forms.widgets.AbstractHyperlink.access$2(AbstractHyperlink.java:311) at org.eclipse.ui.forms.widgets.AbstractHyperlink$4.handleEvent(AbstractHyperlink.java:125) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.swtbot.eclipse.core.UITestApplication.start(UITestApplication.java:54) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 5
401TDQ-5391duplicate a jrxml file, throw exceptionsjava.lang.NullPointerException at org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.getSelctionNode(DuplicateAction.java:241) at org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.selectAndReveal(DuplicateAction.java:205) at org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.run(DuplicateAction.java:137) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 5
402TDQ-5392Implement the rename, move functions on jrxml files and the folders which under "JRXML Template"right click on the folders which under "JRXML Template", show the "Rename"/"Delete" menus right click on the jrxml files which under "JRXML Template", show the "Rename"/"Delete" menus Actions to implement: 1. delete files/folders: list the reports which use the jrxml files: 1) cancel; 2) delete the jrxml files only AND update reports with the basic jrxml configuration 3) delete the jrxml files and reports which use them 2. rename, move and drag files/folder: list the reports which use the jrxml files: 1) cancel; 2) yes, update the reports which use them5
403TDQ-5393the result of report are different between studio and dq portalerr_a Summary Statistics in studio, but Simple Statistics in dqportal err_b Phone Number Statistics in studio,but Simple Statistics in dqportal err_c Text Statistics in studio,but Simple Statistics in dqportal,some Indicator Values are different with the values in Studio20
404TDQ-5394Impossible to delete an empty folder in DQ perspective from recycle bin.Impossible to delete an empty folder in DQ perspective from recycle bin. Tried only on SVN, not sure it's also on local... Note that i didn't try with items inside the folder...8
405TDQ-5395[SVN Repository] Errors when rename a folder which have at least subfolder insideErrors when rename a folder which have at least subfolder inside. Tried this when modifying the basic repository rename folder functions from TDI-21200. But finally when rename a folder this code is not even called it seems. => As explained in the steps, it can make the view totally be empty13
406TDQ-5396DQ Report Generator Uses 32 bit Engine even in 64 Bit StudioA job that is created for a DQ report generates a tLaunchDQReports component with a default value of Talend-Studio-win32-x86.exe even for a 64 bit Studio. When run Studio says it cannot find the jni dll because it is the wrong version, 32 bit rather than 64 bit. Workaround: manually change the value to the correct 64 bit engine.2
407TDQ-5397Data viewer in TOS profiler export of valid/invalid rows fails for Chinese characters• Data viewer and export of valid/invalid rows doesn't work for Chinese characters. The quality check works (for example if I specify that Country = '??' as the clause, it gives me the right % of valid/invalid, but when I export the rows to view them, it's garbage.) I've tried the following connection strings with no luck: jdbc:jtds:sqlserver://localhost:1433/TestDB;characterEncoding=utf-8 jdbc:jtds:sqlserver://localhost:1433/TestDB;characterEncoding=utf8 2
408TDQ-5405Unnecessary page in the new time analysis wizard (branch 4.2)Issue cloned from TDQ-4755 for branch 4.23
409TDQ-5406config oracle database for the report, if don't input the schema of the oracle, check it is ok, when run the report will get exceptionsorg.hibernate.exception.SQLGrammarException: could not execute query at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:67) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) at org.hibernate.loader.Loader.doList(Loader.java:2147) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2028) at org.hibernate.loader.Loader.list(Loader.java:2023) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:393) at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338) at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172) at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121) at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79) at org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.getCachedTdqAnalysis(AbstractPersistenceHandler.java:182) at org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.persist(AbstractPersistenceHandler.java:144) at org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:121) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.historizeData(ReportDocGenerator.java:310) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:159) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:117) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException: ORA-00903: invalid table name at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112) at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:331) at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:288) at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:745) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:219) at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:813) at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1049) at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:854) at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1154) at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3370) at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3415) at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:186) at org.hibernate.loader.Loader.getResultSet(Loader.java:1668) at org.hibernate.loader.Loader.doQuery(Loader.java:662) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224) at org.hibernate.loader.Loader.doList(Loader.java:2144) ... 14 more 5
410TDQ-5407About Installer in the Ubuntu 10 64bit can't show DQ rules and Potential PK report .NULL8
411TDQ-5408DB version is missing in Details View for all kinds of databasesNULL3
412TDQ-5409Resize indicator text fieldThe text indicators' label is truncated in the generated report. See screen capture.8
413TDQ-5425Resolve all failed tests on 5.0NULL3
414TDQ-5429Border of connection selection comb widget is too thickSee the attached screenshot.5
415TDQ-5430for mssql all the catalogs get the same schemas when doesn't set the database filter1. create a mssql connection (in the wizard select "Microsoft SQL Server") 2. check the schema under each catalog. all show same schemas, in fact I create different ones under each. 13
416TDQ-5431Wrong label: "Foramt Frqe"See the pic in attachment.2
417TDQ-5435when I edit a source file, the save status is not changedNULL13
418TDQ-5436got exceptions when empty the recycle binjava.lang.IllegalArgumentException: Path must include project and resource name: / at org.eclipse.core.runtime.Assert.isLegal(Assert.java:63) at org.eclipse.core.internal.resources.Workspace.newResource(Workspace.java:1801) at org.eclipse.core.internal.resources.Container.getFile(Container.java:207) at org.talend.dq.helper.PropertyHelper.getItemFile(PropertyHelper.java:385) at org.talend.dq.helper.DQDeleteHelper.deleteRelations(DQDeleteHelper.java:50) at org.talend.dataprofiler.core.ui.action.actions.DQEmptyRecycleBinAction.doRun(DQEmptyRecycleBinAction.java:148) at org.talend.repository.ui.actions.AContextualAction$2.run(AContextualAction.java:562) at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:2643) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1767) at org.talend.repository.ui.actions.AContextualAction.run(AContextualAction.java:567) at org.talend.dataprofiler.core.ui.action.actions.DQEmptyRecycleBinAction.run(DQEmptyRecycleBinAction.java:94) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 8
419TDQ-5437DQ report: Pattern matching chart is emptySee the attachment screenshot. I also uploaded the analyses and report. for another issue, when set threshold for percentage, and out of threshold, can not show the percentage data. refer to the pic.5
420TDQ-5438DQ report only one column shown to me when I have 4 in column_set reportSee the screenshot5
421TDQ-5440Help page content does not change according to the indicator selectionin the indicator selection window. 8
422TDQ-5441for some dqportal template can not restrieve data which just insert to the datamart1. I just install the dqportal with a new configure and datamart. 2. insert data to the datamart, 3. start up dqportal to view data by the template for some just can retrieve the report name, try to visit the detail content in the file,nothing show. just change the Os time to later, then all can get content. for template have this issue: 1. simple evolution can not show(all simple basic is ok), 2. function dependency basic and evolution can not show. 3. dqrule evolution. 4. column set basic and evolution 5. Redundancy basic and evolution 6. overview analysis-> basic and evolution besides column set basic the can only show the last one executed. what about branch, no build test now, if have, please also make it work well.5
423TDQ-5445Reduce memory consumption of tRuleSurvivorship runtimeNULL5
424TDQ-5446Check datamart without saving the report won't check the correct datamart- Take a new studio. - Create a connection, an analysis and a report (don't run the report). - The datamart in the report is set to HSQL by default. - Change the configuration to MysqL or Oracle (don't save the report editor) - click on "Check" in order to check the connection It will check and create the HSQL datamart, but not the mysql datamart. That's not correct, it should check the values set by the user. 8
425TDQ-5447DQ Portal [Fatal Error] :2:1: Content is not allowed in prologNULL13
426TDQ-5448System Indicators and UDI indicators are mixed in the generated reportCreate a column analysis with the BenfordLaw_sql indicator. Create a report and run it. The generated report mixes the indicators. It should not. See previous reports (in 5.0). Attached: the project items and the generated pdf.8
427TDQ-5449Item lock issues in DQ profiler NULL20
428TDQ-5450disable "Unlock element" menu when corresponding editor is open as in DI repositoryNULL8
429TDQ-5453sql source file does not exist after I click on save actionI did a preview on a table then I click on the save button of the sql editor. The first time, the editor is saved with the name "SourceFile" Repeat the operation, and save the editor. A pop-up says that the filename already exists and suggests a new file name. Click ok, then you got an empty editor (see screen captures). Actually, the new file should be kept opened in the editor just like when you do "save as..." in any application! More over, the files are not saved!2
430TDQ-5454No cheat sheet open when I start TOS DQWhen I start TOS DQ and close the welcome page with the close button (not with the "Start" in the web page), then the cheat sheets view is open but it is empty. 8
431TDQ-5455Look and feel improvements for DQ reports of functional dependancy analysissee attached screenshot5
432TDQ-5458Ignore default report generation folders as well as the symbolic links to avoid svn errorDQ reports are generated into a default folder next to the report definition file, when the generation path is not specified. My project is remote, after generation of reports, I clicked at the "Visualize" button, and have got the following SVN exception: {code} 9697297 [Worker-63] INFO org.talend.dataprofiler.core.tdq.action.ReportDocGenerator - Report "compare" generated. org.talend.commons.exception.PersistenceException: org.tigris.subversion.javahl.ClientException: svn: '/opt/Talend-Studio-r84018-V5.1.1NB/workspace/DQ/TDQ_Data Profiling/Reports/.compare_0' is not a working copy org.talend.repository.svnprovider.SvnEclipseHandler.add(SvnEclipseHandler.java:396) org.talend.repository.svnprovider.SvnResourceChangeListener.visit(SvnResourceChangeListener.java:78) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:68) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:79) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:79) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:48) org.talend.repository.svnprovider.SvnResourceChangeListener.resourceChanged(SvnResourceChangeListener.java:40) org.eclipse.core.internal.events.NotificationManager$2.run(NotificationManager.java:291) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.core.internal.events.NotificationManager.notify(NotificationManager.java:285) {code} where "compare" is the name of my report, and ".compare_0" is the default folder for reports. The svn:ignore property should be added to this kind of folders to avoid this exception.8
433TDQ-5466for the remove duplicate job can not run correctly for db2connection1. create a column analysis 2. select simple statistics,run 3. on result page, right click "distinct/duplicate/unique" indicator, get "remove duplicate" the job generated, but run failed, check the output component, no data set. refer to pic.8
434TDQ-5467if the column/Table view filter doesn't filter the column/table used by function analysis, function anlaysis can not be used 1. create a dbconnection 2. create a function analysis about Tablea, column1, column2. 3. right click "Tablea" under the dbconnceion->column filter,in the pop up dialog set "column3" as "column filter" value. 4. try to open the function analysis, can not 5
435TDQ-5468drag a source file, the file lost it's contentNULL8
436TDQ-5470update related TUJ following the changes in TDQ-5205NULL1
437TDQ-5479Create a JUDI for email validationCreate a JUDI to check emails (see code samples at http://www.rgagnon.com/javadetails/java-0452.html )8
438TDQ-5482add overwrite confirmation for save action with "apply for all files" checkboxNULL13
439TDQ-5485Add an option to enable fuzzy search for tStandardizeRow componentNULL20
440TDQ-5488when import a zip file, get two errors1. import the zip file in TDQ-5437 2. in the dialog, select "Overwrite exsiting items" checkbox there are 2 issues: issue 1: when open analysis, the diaplay is error(see screenshot) issue 2: the pattern/indicator tree display is incorrect I think(see screenshot)8
441TDQ-5489NPE while opening analyzed elements on CE versionNPE throws out,see my attachment {noformat}java.lang.NullPointerException at org.talend.cwm.helper.SubItemHelper.isDeleted(Unknown Source) at org.talend.core.repository.model.ProxyRepositoryFactory.getStatus(Unknown Source) at org.talend.dataprofiler.core.ui.views.provider.DQRepositoryViewLabelProvider.getImage(Unknown Source) at org.eclipse.ui.internal.navigator.extensions.SafeDelegateCommonLabelProvider.getImage(SafeDelegateCommonLabelProvider.java:106) at org.eclipse.ui.internal.navigator.NavigatorContentServiceLabelProvider.findImage(NavigatorContentServiceLabelProvider.java:197) at org.eclipse.ui.internal.navigator.NavigatorContentServiceLabelProvider.getColumnImage(NavigatorContentServiceLabelProvider.java:105) at org.eclipse.ui.internal.navigator.NavigatorContentServiceLabelProvider.getImage(NavigatorContentServiceLabelProvider.java:98) at org.eclipse.ui.internal.navigator.NavigatorDecoratingLabelProvider$StyledLabelProviderAdapter.getImage(NavigatorDecoratingLabelProvider.java:60) at org.eclipse.jface.viewers.DelegatingStyledCellLabelProvider.getImage(DelegatingStyledCellLabelProvider.java:184) at org.eclipse.jface.viewers.DecoratingStyledCellLabelProvider.getImage(DecoratingStyledCellLabelProvider.java:167) at org.eclipse.ui.navigator.CommonNavigatorManager.updateStatusBar(CommonNavigatorManager.java:308) at org.eclipse.ui.navigator.CommonNavigatorManager$1.selectionChanged(CommonNavigatorManager.java:74) at org.eclipse.jface.viewers.StructuredViewer$3.run(StructuredViewer.java:867) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.JFaceUtil$1.run(JFaceUtil.java:49) at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:175) at org.eclipse.jface.viewers.StructuredViewer.firePostSelectionChanged(StructuredViewer.java:865) at org.eclipse.jface.viewers.StructuredViewer.handlePostSelect(StructuredViewer.java:1205) at org.eclipse.ui.navigator.CommonViewer.handlePostSelect(CommonViewer.java:470) at org.eclipse.jface.viewers.StructuredViewer$5.widgetSelected(StructuredViewer.java:1230) at org.eclipse.jface.util.OpenStrategy.firePostSelectionEvent(OpenStrategy.java:251) at org.eclipse.jface.util.OpenStrategy.access$5(OpenStrategy.java:245) at org.eclipse.jface.util.OpenStrategy$3.run(OpenStrategy.java:419) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) {noformat}5
442TDQ-5500After edit the user define indicator, should automatically update the related analysis1. create a analysis, and add a UDI (e.g: user define match) 2. edit the sql of the UDI 3. run the analysis, remain used the old sql of UDI note: should make all the 4 type of UDI work well8
443TDQ-5501evolution result for pattern is not correct.1. create a report file which depends on a column analysis which used pattern. 2. generate the report file with basic type. 3. generate the report file with evolution type check the evolution result: the pattern show as pic, but I doesn't change the data in my database.13
444TDQ-5502the Link with editor works failed for user defined indicatorsI created user defined indicators Then, I selected the "link with editor" button. It does not link anything. Even when I focus on the editor.8
445TDQ-5503column analysis can not run well about sqlserlvler dbconnection with java engine1. try to run colulmn/column set analysis about sqlserver dbconnection with java engine failed. error under Details tab13
446TDQ-5516do migration for 503 get some redudant indicators.1. try to import 423 file by import button (select root directory) 2. after migration finished, (1) all my analysis in folder, now the folders missing, so analysis unavailable for which belong to folders original (2) indicator show as pic why, (3) udi lost, my created pattern also disappear, (4) UDI and pattern in my analysis show as "unknow indicator"5
447TDQ-5520The Data Profile export process does not export the analysisI have exported some analysis from TOS DQ 5.0.2 and tried to import them into TOS DQ 5.1 and they do not import correctly. All of the related items do import, but not the analysis. See the attached document.8
448TDQ-5529import items from 4.1.3 to 4.2.4, miss analysis and reportopen TDQEE 4.2.4 and import the "413MIGRATIONORALCE.zip" into it, in the import dialog, don't show the analysis and report, see screenshot "aaa1.png" click "finish" to import other items found there have error message in the log file, see ".log"8
449TDQ-5530Wrong icon and text in the warning dialog when doing a nominal value analysisDo a right click on two columns of a file delimited connection and select "Column > nominal value analysis". One of the column is of type "nominal" (text, varchar, ...) and the other column is of type "interval" (int, double...) See attached screen capture. The icon and text should have the same look&feel as in the DQ repository view. (Note that there is no problem by doing the same actions on database columns)5
450TDQ-5531Time Analysis generated from contextual menu is not correct.The generated analysis' type is Column Analysis. The selected column is not shown in the configuration page. 8
451TDQ-5534Generated "View table" query does not work with SQL Server 2008see attached screenshot, the error message reads "Invalid object name 'root_db.dbo.Table_ABC'" in English. It was actually not a problem of identifier quotes, but the name of the schema "dbo", which should be "ABC" (a user schema) in my case. Therefore, this issue must be related to JTDS driver and maybe recent changes in TDQ-4884.8
452TDQ-5537Path wrong when drag a pattern to a subfolderWhen I drag a pattern in to a subfolder under Patter/Regex, It can set the path in the property file correctly, but if I drag a pattern folder, each pattern property file will set a wrong path -- ignore the pattern root folder. Example: Drag a folder Code/codePattern.pattern into a subfolder Talend, the path of codePattern changed from Regex/Code to Talend/Code, but it should be Regex/Talend/Code13
453TDQ-5555Move the indicator category section before the indicator definition sectionNULL1
454TDQ-5558some issues about rename a folder under Patterns/Regexissue 1: right click on a folder under Patterns/Regex and click "Rename Folder", show a dialog, but the folder name is empty, it should be the current name of the folder issue 2: when you input a new name for the folder and click ok, it will cost a long time(more than one minute) to finish the rename folder action, and the more pattern files which the folder include the more time will be cost the folder under Patterns/SQL have the same issues drag&drop folders have the same issues other folders need to be checked also8
455TDQ-5562Backport: from trunk to branch 5.0 for the commits on TDQ-5104NULL13
456TDQ-5568import a zip file from 413 version, when delete/remove a source file, get errorissue1: when delete a source file, see the navigate view, the .sql file still there issue2: when move a source file to another folder, see the navigate view, the .sql file is not moved. and open the source file will get error8
457TDQ-5570Export and import a tStandardizeRow job with routines into a differently named project, fail to run it without regenerating the routine file.The reason is that the name of the generated routine includes the original project name, but the new project uses the current project name to generate job code. TODO: remove the project name part from both the routine generation and its usage in the component.2
458TDQ-5572use the menu to create analysis, but after finished, the created analysis is not shown in the DQ Repository viewuse the menus to create analysis(look at the screenshot), but after the created analysis is not shown in the DQ Repository view, should refresh note: seems use the other menu, also can reproduce this, we should make all of them can work well3
459TDQ-5577save failed about edit a system indicator1.Unfold the "Libraries/Indicators/System" in the DQ Repository view 2.Double-click on "Simple Statistics/Distinct Count" indicator 3.Change the text in the description field, save and close 4.reopen the same indicator in the third step ,save failed. you can refer to the screenshot "saveFailed.png" of attachment8
460TDQ-5579Wrong popup: "Adaptive Server Enterprise | Syabase Adaptive Server IQ is repeated" when saving the ind def editorWrong popup: "Adaptive Server Enterprise | Syabase Adaptive Server IQ is repeated" when saving the ind def editor after modify the "description" field.5
461TDQ-5581dependency will lost after click delete label on the analysisColumnTree and don't save it.dependency will lost after click delete label on the analysisColumnTree and don't save it.5
462TDQ-5589Check all DQ repository actions with a remote connectionPay attention to lock status (local lock + remote lock) of repository nodes when 2 or more users are connected. Check also whether the files are properly updated on svn server. Note: svn logs can be activated by adding "--talendDebug" option into "Program arguments". 8
463TDQ-5592delete a folder which contain a locked file need a message to explain the resulttell the user why the delete operation is invalid.5
464TDQ-5601"reload column" failed after the connection is exportNULL8
465TDQ-5602I cannot select text statistics indicators any more after import my project "TEST2"Open the analysis "column analysis summary st" to reproduce. The project "TEST2" can be download from this link: http://jira.talendforge.org/secure/attachment/45132/TEST2.zip8
466TDQ-5606tGenKey's "View Key Profile" seems to be limited to ~20k rowsIt looks like there's a hard limit to the "View Key Profile" option of tGenKey component, limiting the amount of rows to process to something like 20k. Even though there's a textbox to set a custom limit, it looks like it doesn't work in 5.0.2.8
467TDQ-5611Create a TUJ for TDQ-4950NULL2
468TDQ-5612Long response delay for some operations in DQ repository via remote connectionsuch as "rename folder name" action2
469TDQ-5613When rename a folder containing a locked analysis, the analysis disappearsThe rename action is composed by 3 actions: 1. create folder with new name 2. copy contents to new folder 3. delete folder with old name the copy step is blocked by the lock, but the delete step is still processed. That's why we will get an empty folder with new name.3
470TDQ-5614add a dialog to tell user that "the folder containing locked items cannot be moved"NULL1
471TDQ-5616when genereate a job by drill down of phone number indicator ,get errors.1. create a column analysis 2. select phone number indicators 3. run,on result page drill down on the phone number indicator expect valid/invalid region code count. select "Generate a standardization phone number job" get errors, but the job can run successfully.13
472TDQ-5627File connection with context, if revert context and export again run analysis can not get dataa file connection with context edit the connection, revert the context and export the context again run the analysis cannot get result 8
473TDQ-5629Overview report not available in DQ PortalI generate a report in the studio. It's ok in the studio. But I cannot find it in the DQ portal. See attached talend_dq dump. See attached items. 8
474TDQ-5630Analyzed columns limit doesn't work, while create analysis by right click columns in repositoryset the analyzed columns limit value -- like: 3 expand a created connection select some columns in repository more than the set value -- like: 4 then the analysis with 4 columns created and worked, this should not be. and another one as now the columns in analysis has pages, default is 5 per page if set the limit value as 6 or bigger than 6 then can drag columns into analysis editor with no limit8
475TDQ-5632fix the test classes that run as applicationit seems that the following classes are not junit test classes: DBViewer RunDBConnect DataPatternMatchingTest AnalysisCreationTest ConnectionAnalysisCreationTest MoveProviderTest MultiColAnalysisCreationTest MultiNominalColAnalysisTest PatternTest MyFirstTest MyFullDemo ConnectionIndicEvalMain IndicatorEvaluationMain LoadSerialData BubbleChartTest MultiColAnalysisCreationTest13
476TDQ-5634Upgrade Drools to the lastest stable version (Step 1)More and more users pass to Java7. However, Drools 5.2 (currently integrated in our products) is not fully compatible with it.2
477TDQ-5637Remove duplicated MessagesCore classesuse DefaultMessagesImpl instead in each plugin, and let them extend "org.talend.commons.i18n.MessageCore" Duplications of MessagesCore class are found in the following plugins: org.talend.dataprofiler.core org.talend.dataquality org.talend.cwm.management org.talend.datacleansing.core org.talend.dataquality.matching org.talend.dataquality.reporting org.talend.dataquality.standardization8
478TDQ-5641Import of metadata from previous version crashes 5.1.1 ProfilerI newly installed Talend Big Data Edition for MDM release 5.1.1. After importing metadata (flat files and database connections) my profiler crashed 8
479TDQ-5645Column analysis does not pick the right pattern to apply with Oracle DBIn one of my pattern indicator, I have a regex in Default type and a different regex in Oracle type. When I use this indicator to profile a column in my Oracle DB, the one in Oracle type is not always applied. It seems the regex to apply depends on the order of the list. If the Default regex is placed before the one for Oracle, then the Default one is applied.8
480TDQ-5646Icons are missing in conflict dialog when I connect to remote repository.When I connect to a remote repository, if there are svn conflicts, icons are missing for all DQ items, and some texts are not translated. see screenshot8
481TDQ-5650no error message when regex is invalid in the Pattern test view (Java engine)regex is '^(0033|\\\\+\\\\(?33\\\\)?|0)[ ]?[1-689]([-. ]?[0-9]{2}){4}$' Try to input "06 63 36 96 36" and click on test nothing happens. An exception appears in the error log. See below. This exception should be displayed to the user so that he can know that his regex is invalid. java.util.regex.PatternSyntaxException: Unknown inline modifier near index 18 ^(0033|\\\\+\\\\(?33\\\\)?|0)[ ]?[1-689]([-. ]?[0-9]{2}){4}$ ^ at java.util.regex.Pattern.error(Pattern.java:1713) at java.util.regex.Pattern.group0(Pattern.java:2519) at java.util.regex.Pattern.sequence(Pattern.java:1806) at java.util.regex.Pattern.expr(Pattern.java:1752) at java.util.regex.Pattern.group0(Pattern.java:2530) at java.util.regex.Pattern.sequence(Pattern.java:1806) at java.util.regex.Pattern.expr(Pattern.java:1752) at java.util.regex.Pattern.compile(Pattern.java:1460) at java.util.regex.Pattern.<init>(Pattern.java:1133) at java.util.regex.Pattern.compile(Pattern.java:823) at org.talend.dataprofiler.core.ui.views.PatternTestView.testRegularText(PatternTestView.java:447) at org.talend.dataprofiler.core.ui.views.PatternTestView.access$0(PatternTestView.java:440) at org.talend.dataprofiler.core.ui.views.PatternTestView$8.widgetSelected(PatternTestView.java:382) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 1
482TDQ-5651Cannot save a pattern I have imported a pattern from Talend Exchange. I have tested it and then modified it in the pattern editor. When I click on save, I got the attached awful message and no error log message!8
483TDQ-5653Export babili translations into 5.0 branchNULL2
484TDQ-5655Export babili translations into 5.1 branchNULL2
485TDQ-5656Export babili translations into trunk of SVNNULL2
486TDQ-5663report is different with analysis result.report is different with analysis result.8
487TDQ-5664The menu "Cheat Sheets..." can't be found in the help's submenuNULL8
488TDQ-5665check the report generation with exported script when the analysis is locked by another studioNULL1
489TDQ-5668The display of connection URL string in connection editor is not correct in context modeIt should be the context string instead of real jdbc connection url, see the attachment screenshot. Another problem is that the URL and driver class name in item file didn't store as context pattern but as real string for the the normal databases, however, for generic JDBC connection, it's correct. 8
490TDQ-5676Create junits for BaseConnectionContextHelperFirst, make sure that this class is used. Then create a junit.1
491TDQ-5688From the DQ repository tree view, cann't add a task to a column in a DB connection and to an item in an analysisBefore release 5.1, the user could add a task to a column in a database connection under the Metadata node in the DQ repository tree view if he right-click the column and select "add task". In release 5.1, the add task option is removed from the contextual menu (see attached capture) The "add task" option is also removed from the contextual menu of a column in an analysis in the DQ repository tree view (see attached capture).5
492TDQ-5690Ensure the quality of the DQ datamartPhase 1. Use DQ analyses in order to ensure that the DQ datamart does not contain any data of bad quality. Two projects are required: 1. the first project will populate the datamart with all kinds of analyses (these analyses should apply on the TBI test database) 2. the second project will profile the datamart and apply several thresholds and rules in order to ensure the quality of the data stored in the datamart. These two projects already existed in version 3.2.2. Whenever a data of bad quality appears in the datamart, that means that there is a bug in the code. In phase 1, these 2 projects must be upgraded to the last version: 5.1.1. Phase 2: implement new constraints analyses on the datamart in order to check new indicators and new analyses that did not exist in 3.2. This phase is to be defined more precisely later. Phase 3: Process automation. In order to automate the process, the reports should be executed every day (via the tLaunchDqReport component or the exported script) and an email should be sent as soon as a problem of quality appears. If the component is used, then the job could become a TUJ. This phase is to be defined more precisely later. 8
493TDQ-5693Fix an error "FileNotFoundException" and Code refactoringcreate a sql file, and modify its content create a folder, then move the file into folder will throw a file not found error: java.io.FileNotFoundException: Source 'E:\versions\TOS_DQ-r86341-V5.0.3NB\workspace\TOP_DEFAULT_PRJ\TDQ_Libraries\Source Files\SourceFile1_0.1.sql' does not exist at org.apache.commons.io.FileUtils.copyFile(FileUtils.java:636) at org.apache.commons.io.FileUtils.copyFileToDirectory(FileUtils.java:586) at org.apache.commons.io.FileUtils.copyFileToDirectory(FileUtils.java:557) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.moveSourceFileRepNode(Unknown Source) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.computeRepNodeType(Unknown Source) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(Unknown Source) at org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) at org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) at org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) at org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) at org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) at org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:258) at org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) at org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) at org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) at org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) at org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) 13
494TDQ-5694for mdm analysis in java engine can not get the row count, null count successfully for record which contains null value.1. create a column analysis about mdm connection. 2. run with java engine check the result for row count and null count, can not get the rows for which values is NULL. for example, there is an entity has 4 records--a,a, b and NULL, so the 'row count' is 3, and 'null count' is 0, and distinct is 2, in fact should be 4,1 and 3. note: for distinct, both sql and java should change. 13
495TDQ-5695duplicate value for mdm column analysis in java engine always get '0'.1. create a column analysis about mdm connection 2. run in java engine. 3. check the result, the duplicate value always get '0'. pay attention to the NULL count. 8
496TDQ-5700Disable or hide the "unlock" menu when the editor is openwhen the editor is open, we must not be able to unlock it. Or we should close it. Remove the menu when the editor is open. 8
497TDQ-5703Create TUJ for TDQ-3606NULL2
498TDQ-5712when do force delete, the force delete items still in repository need to refresh manually(analysis-report, udi-analysis, pattern-analysis).just as the summary , when the force deleted items' node still need to refresh pay attention to items in sub folder(analysis and report will show the count number).8
499TDQ-5715Code refactoring 2: the save method of sql source file & jrxml tempate - Do it only on trunk (5.2)Currently, the save method of sql source file is implemented in sql explorer plugin. It is not handled by Talend API. This is not good because the property the file item are not considered, when we need to store some information (version etc.) along with save action of file item into property, it's difficult. About the save method of jrxml template, I am not ware of how it works but it should have same problem to sql source file. To do that, in FileItemWriter class, create a save method. In this method , handle file item saving logic in which the property should be considered. 13
500TDQ-5739Fix DatePatternRetrieverTest errorThis test fails on the testing platform. 3
501TDQ-5801can not create mssql dbconnection correctly by wizard 'Miscrosoft SQL Server 2005/2008'try to create a dbconnection by the wizard 'Miscrosoft SQL Server 2005/2008', set the connect information correctly, then click "check". get error. on top work well.20
502TDQ-5747Create a test suiteCreate a test suite only for DQ project, this suite will include all the DQ junits. 5
503TDQ-5750File connection not refreshedWhen you change the name of a FileDelimited connection, the connection list is not updated automatically in an opened analysis form. You have to close it and re-open. 8
504TDQ-5756create TUJs with Oracle and Postgresql database for TDQ-4795 in the schema definition, the analyzed column should have an alias and an original DB column. we have already tMysqlValidRows_11645 for MySQL database, so need similar ones for Oracle and Postgresql. identifier quotes should be considered too.2
505TDQ-5761Clean up DqRepositoryViewServiceTest1. This class contains a lot of commented methods. Why? If the reason is that the methods are not used anymore, then remove the methods from the junit class and also from the tested class. If the reason is that the test failed, then fix the code. 2. remove all the try/catch clause. If an exception occurs, the test will fail and we'll be able to read the exception stack trace. That's enough. 3
506TDQ-5762ConnectionUtilsTest has no assertion. It does not test anythingNULL2
507TDQ-5763Review code in DependenciesHandlerTestA lot of code can be removed in DependenciesHandlerTest.testGetClintDependencyProperty() and the test still passes. Please, review the code. Do we really need to mock objects in this test? Do we really need all these lines? (evidently no) Please, if the code is long, add comments to explain what the test is about. 2
508TDQ-5767convert AnalysisCreationTest into a test classThis class is a main class. It was not designed to be a junit. Now, it must become a real junit. 5
509TDQ-5769convert ConnectionAnalysisCreationTest into a test classThis class is a main class. It was not designed to be a junit. Now, it must become a real junit. 8
510TDQ-5770Create a junit about moving resourcesMoveProviderTest is useless now. Delete this class. Instead, create a Junit class that will test the move of an item. (Or does it already exist?)8
511TDQ-5771convert MultiColAnalysisCreationTest into a test classThis class is a main class. It was not designed to be a junit. Now, it must become a real junit. 5
512TDQ-5772convert MultiNominalColAnalysisTest into a test classThis class is a main class. It was not designed to be a junit. Now, it must become a real junit. 5
513TDQ-5773Delete PatternTest and create some tests related to the jdbc urls if none existsNULL1
514TDQ-5774Implement DbmsLanguageFactoryTest methodsNULL8
515TDQ-5775Review DQDeleteHelperTest1. One method has no assertion. It's useless. Please fix that. 2. Confirm that we really need to mock all these objects.2
516TDQ-5777implement empty methods in TableViewComparisonLevelTestNULL8
517TDQ-5778implement methods in ReportSubFolderRepNodeTestNULL3
518TDQ-5779Replace ReportDocGeneratorTest by a meaningful testNULL5
519TDQ-5780Review CreateParserRuleFolderTaskTest. This test is emptyNULL1
520TDQ-5781remove try/catch clauses in WorkspaceResourceHelperTestNULL1
521TDQ-5782No assertion in RefactMdmMetadataTaskTest. Fix it. NULL1
522TDQ-5783No assertion in SplitSysIndicatorTaskTest. Fix it.NULL1
523TDQ-5785remove try/catch clause in CreateDuplicatesAnalysisActionTestNULL1
524TDQ-5786implement ColumnMasterDetailsPageTestNULL5
525TDQ-5787Clean up AnalysisColumnTreeViewerTest (remove warnings)NULL1
526TDQ-5788Clean up WorkbenchUtilsTest (too many lines commented)NULL1
527TDQ-5790Add assertion about the returned values in EcosystemServiceTest NULL1
528TDQ-5791convert JasperTest into a real junit classNULL8
529TDQ-5792Convert MyTest and SynonymTest to a junit or delete itNULL3
530TDQ-5793implement empty methods in DqStringHandlingTestNULL3
531TDQ-5799oracle can not get tablescreate an oracle dbconnection, can not get table, ok on top but can not on tdq8
532TDQ-5803run DQ Rule Evolution in DQPortal, got an empty page[http-8580-5] 09 Jul 2012 16:51:59,330 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't exist com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723) com.mysql.jdbc.Connection.execSQL(Connection.java:3283) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332) com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1467) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction(TableGenerator.java:483) org.hibernate.engine.TransactionHelper$1Work.doWork(TransactionHelper.java:61) org.hibernate.engine.transaction.Isolater$JdbcDelegate.delegateWork(Isolater.java:249) org.hibernate.engine.transaction.Isolater.doIsolatedWork(Isolater.java:70) org.hibernate.engine.TransactionHelper.doWorkInNewTransaction(TransactionHelper.java:74) org.hibernate.id.enhanced.TableGenerator$1.getNextValue(TableGenerator.java:466) org.hibernate.id.enhanced.OptimizerFactory$NoopOptimizer.generate(OptimizerFactory.java:194) org.hibernate.id.enhanced.TableGenerator.generate(TableGenerator.java:463) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:210) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:56) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:195) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:50) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:93) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:713) org.hibernate.impl.SessionImpl.save(SessionImpl.java:701) org.hibernate.impl.SessionImpl.save(SessionImpl.java:697) it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:73) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-5] 09 Jul 2012 16:51:59,330 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't exist com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723) com.mysql.jdbc.Connection.execSQL(Connection.java:3283) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332) com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1467) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction(TableGenerator.java:483) org.hibernate.engine.TransactionHelper$1Work.doWork(TransactionHelper.java:61) org.hibernate.engine.transaction.Isolater$JdbcDelegate.delegateWork(Isolater.java:249) org.hibernate.engine.transaction.Isolater.doIsolatedWork(Isolater.java:70) org.hibernate.engine.TransactionHelper.doWorkInNewTransaction(TransactionHelper.java:74) org.hibernate.id.enhanced.TableGenerator$1.getNextValue(TableGenerator.java:466) org.hibernate.id.enhanced.OptimizerFactory$NoopOptimizer.generate(OptimizerFactory.java:194) org.hibernate.id.enhanced.TableGenerator.generate(TableGenerator.java:463) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:210) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:56) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:195) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:50) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:93) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:713) org.hibernate.impl.SessionImpl.save(SessionImpl.java:701) org.hibernate.impl.SessionImpl.save(SessionImpl.java:697) it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:73) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-5] 09 Jul 2012 16:51:59,333 ERROR org.hibernate.util.JDBCExceptionReporter.logExceptions:234 - Table 'tdqportal.hibernate_sequences' doesn't exist [http-8580-5] 09 Jul 2012 16:51:59,333 ERROR org.hibernate.util.JDBCExceptionReporter.logExceptions:234 - Table 'tdqportal.hibernate_sequences' doesn't exist [http-8580-5] 09 Jul 2012 16:51:59,334 ERROR it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit:77 - org.hibernate.exception.SQLGrammarException: could not get or update next value [http-8580-5] 09 Jul 2012 16:51:59,335 ERROR it.eng.spagobi.monitoring.dao.AuditManager.insertAudit:251 - Error doing audit insertion it.eng.spago.error.EMFUserError: severity [ERROR] description [Generic Error] it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:80) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-2] 09 Jul 2012 16:52:18,393 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't exist com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723) com.mysql.jdbc.Connection.execSQL(Connection.java:3283) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332) com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1467) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction(TableGenerator.java:483) org.hibernate.engine.TransactionHelper$1Work.doWork(TransactionHelper.java:61) org.hibernate.engine.transaction.Isolater$JdbcDelegate.delegateWork(Isolater.java:249) org.hibernate.engine.transaction.Isolater.doIsolatedWork(Isolater.java:70) org.hibernate.engine.TransactionHelper.doWorkInNewTransaction(TransactionHelper.java:74) org.hibernate.id.enhanced.TableGenerator$1.getNextValue(TableGenerator.java:466) org.hibernate.id.enhanced.OptimizerFactory$NoopOptimizer.generate(OptimizerFactory.java:194) org.hibernate.id.enhanced.TableGenerator.generate(TableGenerator.java:463) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:210) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:56) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:195) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:50) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:93) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:713) org.hibernate.impl.SessionImpl.save(SessionImpl.java:701) org.hibernate.impl.SessionImpl.save(SessionImpl.java:697) it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:73) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-2] 09 Jul 2012 16:52:18,393 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't e...5
533TDQ-5817Add google fingerprint keyer to tGenKeyNULL8
534TDQ-5818Add q-gram keyer to tGenKeyNULL8
535TDQ-5820From issue: TDQ-5801 provide a wizard to help migrating all connections at onceWhat we will do only in 5.2 is to provide a wizard to help migrating all connections at once13
536TDQ-5823add Apache ColognePhonetic to tGenKeyhttp://commons.apache.org/codec/apidocs/org/apache/commons/codec/language/ColognePhonetic.html8
537TDQ-5824tGenKey improvementsAdd several algorithms to the tGenKey component8
538TDQ-5825Assign old "dev done" issue to QASee filter http://jira.talendforge.org/secure/IssueNavigator.jspa?mode=hide&requestId=129938
539TDQ-5826Close QA done issueshttps://jira.talendforge.org/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+TDQ+and+status+%3D+%22QA+done%22+ORDER+BY+createdDate+asc5
540TDQ-5837Fix column name issue described in TDQ-4929Nicolas Rousseau added a comment - 11/Jul/12 8:56 PM I review the junits on this today, and find some problem related to this bug. This one should be ok normally: CoreRuntimePlugin.getInstance().getDesignerCoreService().getDesignerCorePreferenceStore() .setValue(IRepositoryPrefConstants.ALLOW_SPECIFIC_CHARACTERS_FOR_SCHEMA_COLUMNS, false); columnName = MetadataToolHelper.validateColumnName("MyColumn_你好", 0); assertEquals("MyColumn___", columnName); But with the this change commited, it's not. 1
541TDQ-5847Genarated reports are lost after I rename the reportNULL13
542TDQ-5848Queries are not working on Sybase When I try to run a auery in the explorer perspective on a sybase database, I havethe following error. 8
543TDQ-5849Pattern test Result for PostgreSQL database connection shows "matches" about the wrong url 1. create a postgreSQL connection 2. open pattern editor -- " Website_URL" (Patterns-->Regex-->internet) 3. add postgreSQL definition, (you can copy a MySQL definition) 4. click on test button to test if it works well The issue : When I input the wrong url "www.baidu" the test result shows matches, refer to the "wrong.png" When I input the right url "www.baidu.com" ,the test result still shows matches refer to the "right.png"5
544TDQ-5850should not check connection when select a DBConnecion1.start/restart a studio(there some DBConnection are in the worksapce). 2.select a connection(make the connection connect fail before starting the studio). 3.it will check the connection,and throw exception: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.NullPointerException org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.getConnection(ExtractMetaDataUtils.java:567) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getConnection(MetadataConnectionUtils.java:1153) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getClassDriver(MetadataConnectionUtils.java:624) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:198) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:295) org.talend.core.model.metadata.builder.database.JavaSqlFactory.createConnection(JavaSqlFactory.java:148) org.talend.cwm.management.api.SoftwareSystemManager.getSoftwareSystem(SoftwareSystemManager.java:66) org.talend.dataprofiler.core.ui.views.RespositoryDetailView.createDataProviderDetail(RespositoryDetailView.java:641) org.talend.dataprofiler.core.ui.views.RespositoryDetailView.selectionChanged(RespositoryDetailView.java:265) it's seems caused by detail view.I think we should not check the connection at this time.8
545TDQ-5851column set analysis cannot run while file connection with contextcolumn set analysis cannot run if a file connection has context8
546TDQ-5853Connection incorrectly retrieved in Data Explorer with SQL Server Windows authentication I create a SQL Server connection with a Windows authentication. It works for analysis, I can run them. But when I try to use the data explorer perspective, I have a connection failed because TDQ tries to set the username to "root" which is not correct. It ask me to review the connection when I clink on yes, and it sets the username to root, I tries to remove it , I still have the error.8
547TDQ-5858column analysis with jdbc connection can't stop to run1.import a jdbc connection and related analysis by button(the project form other PC,so the drive path dosen't exist on my computer ). 2.run the related analysis.can not stop to run. 3.print many errors on the studio log view.and errors on the console view: Caused by: java.lang.NullPointerException java.lang.Class.forName0(Native Method) java.lang.Class.forName(Unknown Source) org.talend.core.model.metadata.builder.database.JDBCDriverLoader.getConnection(JDBCDriverLoader.java:80) ... 15 more ERROR: java.lang.RuntimeException: java.lang.NullPointerException 331997 [Thread-7] ERROR org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils - java.lang.RuntimeException: java.lang.NullPointerException ERROR: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.NullPointerException java.lang.RuntimeException: java.lang.RuntimeException: java.lang.NullPointerException org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.getConnection(ExtractMetaDataUtils.java:567) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getConnection(MetadataConnectionUtils.java:1153) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getClassDriver(MetadataConnectionUtils.java:624) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:198) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:295) org.talend.core.model.metadata.builder.database.JavaSqlFactory.createConnection(JavaSqlFactory.java:148) org.talend.dq.analysis.connpool.TdqAnalysisConnectionPool.newConnection(TdqAnalysisConnectionPool.java:145) org.talend.dq.analysis.connpool.TdqAnalysisConnectionPool.getConnection(TdqAnalysisConnectionPool.java:126) org.talend.dq.analysis.AnalysisExecutor.getPooledConnection(AnalysisExecutor.java:311) org.talend.dq.analysis.ColumnAnalysisSqlExecutor.runAnalysis(ColumnAnalysisSqlExecutor.java:1049) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:111) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:154) org.talend.dataprofiler.core.ui.action.actions.AnalysisExecutorThread.run(AnalysisExecutorThread.java:86) java.lang.Thread.run(Unknown Source) 5
548TDQ-5889Store the report execution time in the datamartSee related issue TDQ-4234. Store this execution information in the fact tables of the datamart. Add two columns in the 4 fact tables: REP_DURATION and REP_RUNTIME (TDQ_MATCH_INDVALUE, TDQ_OVERVIEW_INDVALUE,TDQ_SET_INDVALUE, TDQ_INDICATOR_VALUE) Then create a datamart migration task. 8
549TDQ-5898Unable to query Teradata TDQAnalysis will not run and we are unable to query views or tables in the tool. Getting nullpointerexception and conversion errors when querying Teradata through both the Explorer and Profiler. Using both JDBC-ODBC and JDBC connections. Works in Open Profiler 5.0.2. "Screenshot2012071813325.png" Error when running a simple query to bring back a single column in the Explorer. "H Doty error log file copy.log" is the log after the Explorer nullpointerexception "2.log" is from the error on the Profiler Analysis8
550TDQ-5903Create a tGenKeyHadoop componentThis component reads data on HDFS and applies the algorithms as defined in the tGenKey component. The data always stay on hadoop. This component will require the use of a tHDFSConnection in order to connect to hadoop. The properties of this component are the same as those from tGenKey plus some properties to define the data format: - the HDFS file URI - the field separator - an option to link with another tGenKeyHadoop component (unchecked by default) When the option to link with another tGenKeyHadoop is selected, the output of the previous component becomes the input of the current component. The schema of this component will be defined manually by the user except the fixed T_GEN_KEY column. But this fixed column must be automatically renamed when several tGenKeyHadoop components are linked together. That means the first component has a T_GEN_KEY_1 column, the second component a T_GEN_KEY_2 column, etc. In the Map/reduce implementation, no reducer is required here. Only a Mapper class is necessary as each record is handled independently. 13
551TDQ-5904Allow the tMatchGroupHadoop component to work with HDFS data file directlyCurrently, this component reads local data and loads them into HFDS. We want to avoid this step in some cases. The component will still be able to load data into HDFS, but there should be an option so that the component will just read data existing in HDFS. The properties of the component will be: - the same as before plus - a checkbox "use existing HDFS file" (by default unchecked) - when checked, a new property : the "HDFS file URI" when the checkbox is checked, the component can be a starting component (meaning that a job can start with this component). 8
552TDQ-5905Add an option to link together a tMatchGroupHadoop component with a tGenKeyHadoop componentAdd an option in the properties of the tMatchGRoupHadoop component : "link with tGenKeyHadoop". (checkbox + dropdown list to select a component) When unchecked, the behavior is just the same as before. When checked, the input of this component is the output generated by the tGenKeyHadoop component. 13
553TDQ-5906Allow the tMatchGroupHadoop component to use a tHDFSConnectionAdd a property in the component to use an existing tHDFSConnection component: "use an existing connection" checkbox + dropdow list When the checkbox is checked, the connection to HDFS is done via the selected tHDFSConnection component, and the previous connection properties are hidden. when the checkbox is unchecked, the connection is set as before. 8
554TDQ-5907Enable Hive profilingEnable Hive database connection in the profiler. 1. add Hive as a supported database connection in TOS-DQ 2. check all analyses and all indicators against Hive (with SQL engine). 3. check also the java engine 4. adapt the SQL templates of the indicators definition when required 8
555TDQ-5908for reload function cause the dbconeection disappear1. create a mysql dbconnection 2. click a certain catalog, to get tables and views. 3. do "Reload table list", then do "Reload database list", then redo "Reload table list" after these functions, will get errors(attached in Details tab), and refresh reporsitory dbconnection disappear.8
556TDQ-5909the wizard information should not show the type name for fileConnection when import/export and delete1. create a file connection, and create analysis about it. 2. try to delete the file connection, get inform information 3. try to export/import file analysis, and un-check the file connection. get inform the inform information doesn't show the file connection name , but seems like type name.3
557TDQ-5910Build a new datamart.jar file for QBE AFter the change done in TDQ-5889 create a datamart.jar that will be used in QBE. Don't forget to add labels for the new columns in the properties file. 5
558TDQ-5912Use the last version of HSQL DB in the DQ portalThe current 1.8.0 version is 4 years old. We should upgrade to the new version. 8
559TDQ-5923the threshold lose for the pattern after adding a new pattern1. create a column analysis, add a pattern for one column. 2. set threshold for the pattern 3. add another pattern for the same column the threshold set for the first pattern disappear. pay attention to add by the icon in the analysis editor and also drag one to column 5
560TDQ-5926Tables without Fk can not show the content for oracle datamartfor oracle datamart 1, TABLES WITHOUT FK can not show the content,just a blank page show. (512 and 520)attached error in details tab 2, for Simple Evolution and Pattern Evolution, for the pattern result, will show two chart, but Report generated by studio and mysql dqportal just show one, we should unify it. (512 and 520) 3, the header of "Pat_matching evolution" and "Simple stats evolution" should be "Table.column", lose ".column" (512,520) for the issue 2, if we show two pic please move the Null item13
561TDQ-5933Junit for feature TDQ-5847Reproduce the issue by a Junit if possible. 8
562TDQ-5952Make the number of connections being configurable in preference used per analysis.Currently , there is no way to reuse a single connection throughout an analysis. Make the number of connections being configurable in preference used by per analysis, the default value is 1.20
563TDQ-5959for the migration information about update the product version doesn't store in the tdq_migration table.1. create a datamart by the earlier version 2. try to migrate datamart to current version. 3. successfully, but the operation of updating product version doesn't store in tdq_migration table3
564TDQ-5962Duplicated connection can't be expanded1.create a new connection 2.duplicate one based on this connection 3.the duplecated connection can't be expanded(don't have the sign '+' on UI),must reload it.8
565TDQ-5967try to import the parser rule, but it goes to sql folder not Parser one.try to import a parse rule file, in the import dialog , it can show the correctly path, after imported, the parser file will goes to the SQL folder, but it should go to Parser folder. pay attention also to cmd line project 5
566TDQ-5968try to check tdq_rule file under commandline project, can not get any items.1. import some items to commandline project. 2. check items by "listItem" can get the tdq_rules file. 3. try to get by "listItem -if type=tdq_rules", get nothing. check the filter type, it is tdq_rules. now dq have a parser rule file, how can we distinguish them by the type name8
567TDQ-5969dqportal can not show the report content it is for all template issue 1 install a mysql datamart installer start hsql first then tomcat. visit the webpage, try to get the report content failed, all template can get the report list, but can not get report content attached the logs and pic(dqportalGeneratedFailed and SpagoBI.log) issue 2, the apperance seems different from others, refer to the pic("FrequencyBasic and Evolution" and "Normal")2
568TDQ-5973we'd better refactor the method "runAnalysis" for abstract class AnalysisExecutorthe method "runAnalysis" in every implemetation classes of AnalysisExecutor contain the following three parts: part 1: open a connection part 2: indicatorEvaluator define and evaluateIndicators part 3: close the connection we can do like this: part 1 and part 3 extract two new methods in abstract class AnalysisExecutor, and used by every implemetation classes 13
569TDQ-5974try to view rows on result page by context menu, but get some errors1. create column analysis, column set analysis and functional dependency analysis 2. try to view row on these three kind of analysis get errors, but we can get result.2
570TDQ-5980Additional tMatchGroup options for NULL valuesNull values can cause false positive matches where both fields are null, create false negatives when a good match when one field is NULL, etc. I'd like to see some control given to the user, Advanced options, that would be usefull for tMatchGroup (and tRecordMatching) - NULL only matches NULL i.e. NULL == NULL therefore this fields scores 1.0 - NULL matches everything i.e. CHAPMAN == NULL therefore this fields scores 1.0 (or better (possibly) the weight for this field becomes 0, i.e., this column is not considered any further and only the remaining fields are compared) - NULL never matches anything i.e CHAPMAN != NULL, NULL != NULL therefore these fields score 0.0 5
571TDQ-5981Additional tMatchGroup options for multiple matching rulesI'd like to see tMatchGroup allow multiple matching strategies. For example, - Match on Name & Address - Match on DOB & Phone - Match on Name & Email address To improve the performance, this is a strategy that I have used in the past. - Match the fields (Name, Address, DOB, Phone, Email Address) - Specify the rules: Name And (Address or Email or Phone or DOB) OR DOB + (Phone or Email) Each may have their own blocking keys too. ie. if the match was not found, it may be because the Blocking Key was bad The point is that I want to match using multiple strategies because not all fields are 'fit for purpose' for a matching strategy. At the moment, I have to use multiple tMatchGroups and 'merge' the result sets from two or more outputs 13
572TDQ-5983Junit for feature TDQ-5907NULL8
573TDQ-5989Drill down function -- view rows on Hive connection, close sql editor before get result will throw OOE create a column analysis with Hive connection after analyzed this column, turn to result page right click one indicator, -- view rows then will open an sql editor to select the data but if close the editor before it get result will throw an OOE error I will attach the error log file here.5
574TDQ-5990Create version 5.2.0M3 in Babili and populate itNULL2
575TDQ-5993there is some issue about source file for rename folderon build r89207-5.1.2,r89207-5.2.0(windows): find issue rename folder, then rename file in the folder get error, bug doesn't affect the other function. on r88970-5.0.4: rename a folder lead to the file which crated by right click the folder in it lose its content (tdq) 5
576TDQ-5999the detail infomation is incorrectsee the screenshot the context Name and context Group Name are opposite. the purpose and description should display(2 case: in the wizard set or after created connection, then open editor, set) 3
577TDQ-6005Create a configuration to automatically filter only DQ tasksWhen the user opens the task view the first time, it should only display DQ tasks. 8
578TDQ-6006Support DQ portal on Weblogic* Support DQ Portal on Weblogic 11 13
579TDQ-6009Add the ability to edit context in the Profiler viewadd the "Contexts" node in the DQ repository view and add all menus existing in DI. 20
580TDQ-6010Improvement of the indicator selection window1. same request as in TDQ-2751 2. improvement scroll performances suggested requirements: The current panel is very hard to use and not scalable ; main problems with this design are: - very slow scroll with +10 columns (and some open indicators) - hard to read column name (need to resize the column every time) on the top - small number of column - first column with indicator name is not fixed, when you scroll right, it disappear - etc. I've enclosed a mockup of a new GUI for this Panel. - the Indicator column should be fixed. - the Top "Selected Column" should be fixed - the green minus allow you to hide a column - the red cross allow you to delete the column - the green plus allow you to unhide hidden column(s) (with #) - yellow is a dynamic highlighter showing you current selection20
581TDQ-6013the Redundancy Evolution template can not retrieve correct report listissue 1: for the Redundancy Evolution template can not retrieve report correctly. it get the report about column analysis with use pattern, but should the report which use content Compare analysis--- on 5.2 issue 2: the overview evolution can not show the content, should change the time, can dev check the reason--512 mysql(5.2 oracle doesn't work now, hope it work well also). issue 3: the Potential pk can not show content on 5.2.0 oracle issue 4: the Threshold KPI just show two pic, should be 4, refer to the pic attached. issue 5: for the "Integrity Report->Column Size analysis" template , the content show the Item more than once, refer to the pic ""13
582TDQ-6014Implement the tGenKey improvements into the tGenKeyHadoop componentSee original tGenKey component improvements.3
583TDQ-6015tGenkeyHadoop component issues1. if link two tGenkeyHadoop component, and check the second component "link with a tGenkeyHadoop" the second one will got an error icon on the component, save and reopen job, eidt the schema, "T_GEN_KEY_*" column editable it should not be 2. in basic setting, if uncheck "link with a tGenKeyHadoop" in the advanced setting, the text box "separator" is visible, the text box is visible or not should be judged by the checkbox "use existing HDFS file" 3. the input schema do not contain "T_GEN_KEY" column, while link to tGenKeyHadoop component will auto add this column for tGenKeyHadoop but in the "Algorithm" column list, T_GEN_KEY shows up, this should not be2
584TDQ-6032download UDI issues1, when upload the zip contains: sql template & relate UDI jar, only the sql can be showed in UDI editor, no jar displayed. 2, when there are several versions in exchange, when downloading, the user can not choose. 3, when the content of the exchange modified, fresh the exchange can not make the exchange reload.13
585TDQ-6033Junit required for commit r89240NULL3
586TDQ-6038Deselect all rules of table analysis, after finish will throw NPEcreate a table analysis and a rule, add this rule to analysis in editor, click "add business rule" icon button to add or delete rules click button "Deselect All" then OK will throw a NPE error {code} java.lang.NullPointerException at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.removeItemBranch(AnalysisTableTreeViewer.java:775) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.removeUncheckedWhereRuleIndicator(AnalysisTableTreeViewer.java:524) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.showAddDQRuleDialog(AnalysisTableTreeViewer.java:470) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.access$4(AnalysisTableTreeViewer.java:414) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer$6.mouseDown(AnalysisTableTreeViewer.java:363) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:185) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}3
587TDQ-6048Match data job and Deduplicate data job failed to read input schemafollow cheat sheet steps to create job "Match Data job" and "Deduplicate Data job" while at the step "Choose Matching Fields" cannot get input schema and I got an error in "Problems" view -- "No schema has been defined yet." but I checked the file that I select, there is a schema in it2
588TDQ-6049we'd better refactor the properties saveissue1: now, the properties values(Status,Author,Purpose,Description,Version) are saved at two places, both the *.item and *.properties files I think this is no need. we should save them at one file. (otherwise, save at two places, we must make sure they are alway the same when update/create ) we should consider all items, now in dq, just the connection save status is different from others. but if we considerd DI, the connection save status almost the same as DI(the propertes just save in the *.propertes file). two solutions: 1. all the properties values save at the *.propertes file.(unify with DI) 2. all the properties values save at the *.item file.(different with DI) issue2: delete the property "filename" from TDQItemImpl seems this is useless and only remain this property for source file and jrxml type file13
589TDQ-6052the tMatchGroupHadoop is different from tMatchGroup for one column create a job with a tMatchGroupHadoop,for the configuration of the component refer the job attached. I get a result which blocking keys "id" and "id2" are not same between two rows, but group them to one. test with tMatchGroup, they are not in one group. 1
590TDQ-6054the report can not run successfully when it contains a column analysis using the emailValidationJUDI1. create column analysis add the emailValidationJUDI java udi. 2. run analysis, successfully. 3. generate report file about this analysis. failed get error(on details tab) three kinds of datamart all will get error.8
591TDQ-6070The report about the average length indicators is wrong in the dq portal, fix it. The average does not seem to be computed. Instead, it's the sum that it computed. 8
592TDQ-6081Create version 5.2.0M4 in Babili and populate itNULL2
593TDQ-6085Export babili translations into trunk of SVNNULL2
594TDQ-6089fix some bad practices1. on the ResourceViewLabelProviderTest and UnitTestBuildHelper have some try catch structor, they hold back error to impact junit result. so need to add Assert.fail in it. 2. in ColumnAnalysisSqlExecutor line 741 add NON-NLS tag. 3. on the ReportExecutor maybe don't support ui so instead it by log.error.2
595TDQ-6091Workitem to write a junit for TDQ-5993Rename SQL file action method need a junit test.3
596TDQ-6092for the "view Compare" show the db root structure but not views for several kinds of db1. create an oracle dbconnection. 2. try to unfold a schema to views, right click the view folder->view compare, an editor open, but doesn't show the information of views, but schemas. you can also reproduce this by:(1) right click database ->database compare, in the open editor right click on one schema->compare the lists of views. this issue exist on teradata, sqlserver, db2, postsql. for mysql it is ok.13
597TDQ-6096SQL explorer cannot preview Ingres table/columnSee attach picture.8
598TDQ-6099Fail to run column analysis with Teradata Interval Year1.create an ODBC Teradata connection. 2.create a column analysis with a column which is Interval Year date type. 3.select "Blank count" and some Textual indicators. 4.can not run successfully,will get an error and warning(see Detail page,we can find this error in TDQ-5898 2.log ). Even if it is JDBC Teradata,could get this error. I think that some indicators should be disabled for the Interval Year date type. 13
599TDQ-6100delete "ITEMS" function doesn't work wellcreate some items, like (connections, analyses, UDIs ...) select at least two items do delete just one can be deleted and throw this error: {code} java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.eclipse.ui.internal.progress.ProgressMonitorJobsDialog.run(ProgressMonitorJobsDialog.java:275) at org.eclipse.ui.internal.progress.ProgressManager.run(ProgressManager.java:1162) at org.talend.repository.ui.actions.DeleteAction.doRun(Unknown Source) at org.talend.repository.ui.actions.AContextualAction$2.run(Unknown Source) at org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.ui.actions.AContextualAction.run(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.excuteSuperRun(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.run(Unknown Source) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.RuntimeException: The service org.talend.designer.core.IDesignerCoreService has not been registered. at org.talend.core.GlobalServiceRegister.getService(Unknown Source) at org.talend.repository.ui.actions.DeleteAction$1.run(Unknown Source) at org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) at org.talend.repository.ui.actions.DeleteAction$2.run(Unknown Source) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 42 more Root exception: java.lang.RuntimeException: The service org.talend.designer.core.IDesignerCoreService has not been registered. at org.talend.core.GlobalServiceRegister.getService(Unknown Source) at org.talend.repository.ui.actions.DeleteAction$1.run(Unknown Source) at org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) at org.talend.repository.ui.actions.DeleteAction$2.run(Unknown Source) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.eclipse.ui.internal.progress.ProgressMonitorJobsDialog.run(ProgressMonitorJobsDialog.java:275) at org.eclipse.ui.internal.progress.ProgressManager.run(ProgressManager.java:1162) at org.talend.repository.ui.actions.DeleteAction.doRun(Unknown Source) at org.talend.repository.ui.actions.AContextualAction$2.run(Unknown Source) at org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.ui.actions.AContextualAction.run(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.excuteSuperRun(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.run(Unknown Source) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}13
600TDQ-6104Export babili translations into 5.1 branchNULL2
601TDQ-6108[SVN Repo] when rename a folder which does not exist, an empty folder will be created without any content. "which does not exist" means it is moved/deleted by others but not refreshed locally TODO: check the existance of the folder at first.3
602TDQ-6109Move all QAS components in the "Data Quality/Address/QAS" folder in the paletteNULL1
603TDQ-6114the remove duplicate job can not run correctly with postgresql1. create a column analysis 2. select simple statistics,run 3. on result page, right click "distinct/duplicate/unique" indicator, get "remove duplicate" the job generated, but run failed, check the output component, no data set. refer to pic.8
604TDQ-6120Remove the option panel from the benford law indicatorThis indicator has currently no option. Set the usual pop up "no option to set" when you click on the indicator's options. 2
605TDQ-6121Graphs are displayed twice when we add a new indicatorCreate a column analysis with the benford law indicator and simple statistics. Run the analysis. There are two charts. (which is normal) Click on select indicators and add the summary statistics indicators. Now, the first two charts are duplicated and I have 5 charts. (If I refresh, the duplicate charts disappear). 8
606TDQ-6122Improve the Benford law chart1. The bars must be at the same positions as the dots, even when there is some invalid data. Possible ways to customize the colors of a single bar: http://javabeanz.wordpress.com/2007/07/04/creating-barcharts-with-custom-colours-using-jfreechart/ http://stackoverflow.com/questions/4952931/jfreechart-is-it-possible-to-change-the-bar-color 2. Change the colors to: - for 1 - 9 digit, bars must be in Talend's green color (like for null count indicator, see attached screen capture). - for the Benford law dots, keep the blue color. - for the invalid data, use the red color. 8
607TDQ-6123Adapt the report for the Benford Law indicatorThe current report about the Benford Law indicator is not correct. Display the same chart as in the studio. And change the value table to an appropriate table (see attached screen capture)3
608TDQ-6130Backport changeset of TDQ-5700 from trunk to branch 5.1 and 5.0NULL3
609TDQ-6138RepDuration,RepRuntime should not show in the QBEinstall the 512 dqportal by installer build. check the QBE part, RepDuration,RepRuntime nodes show under Overview Indicator Valued...in the Query tab. it should not.1
610TDQ-6149BRMS Repository Connection LimitIn the repository it is impossible to create multiple BRMS connections to the same package. It is necessary when you want to access different classes that have been uploaded to one package in the Guvnor. If I have 3 different classes org.talend.polygon.Triangle, org.talend.polygon.Square, org.talend.polygon.Pentagon that are in a single jar polygons.jar which I have uploaded to the Guvnor under the package org.talend.polygon, I can only access 1 class at a time in the same package. {code} Exception in component tBRMS_1_In Unable to access binding information for class org.talend.polygon.Square Make sure the binding has been compiled java.lang.NoSuchFieldException: JiBX_bindingList java.lang.Class.getDeclaredField(Class.java:1882) org.jibx.runtime.BindingDirectory.getBindingList(BindingDirectory.java:68) org.jibx.runtime.BindingDirectory.getFactory(BindingDirectory.java:211) demos.testsquare_0_1.TestSquare.tBRMS_1_InProcess(TestSquare.java:1214) demos.testsquare_0_1.TestSquare$1ThreadXMLField_tBRMS_1_Out.run(TestSquare.java:486) {code}5
611TDQ-6152Check the instanceof&if/else assertions for the WhereRuleAideIndicator in codeTimes ago, we created a new WhereRuleAideIndicator class along with WhereRuleIndicator in order to compute the DQ rule percentage value when there is a join condition. But the code is not correctly handled for some condition statements, for example it opens one bug TDQ-6038 due to the lack of assertion for WhereRuleAideIndicator in AnalysisTableTreeViewer.getOwnedWhereRuleFiles?....? The aim of this work item is to check again for the code where it can be impacted. One easier way is to look up key word: "WhereRuleIndicator", then decide whether WhereRuleAideIndicator considered or not at the same place.2
612TDQ-6156can't create sybase database connectionon database wizard, create a sybase database connection, click check will throw the following exception: {code} java.lang.RuntimeException: java.sql.SQLException: JZ0I5: ?????????? CHARSET ??: GBK? at org.talend.core.model.metadata.builder.database.JDBCDriverLoader.getConnection(JDBCDriverLoader.java:127) at org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.connect(ExtractMetaDataUtils.java:810) at org.talend.core.model.metadata.builder.database.ExtractMetaDataFromDataBase.testConnection(ExtractMetaDataFromDataBase.java:290) at org.talend.repository.ui.utils.ManagerConnection.check(ManagerConnection.java:143) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm.checkConnection(DatabaseForm.java:902) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm.access$19(DatabaseForm.java:848) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm$4.widgetSelected(DatabaseForm.java:1071) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.jface.window.Window.runEventLoop(Window.java:825) at org.eclipse.jface.window.Window.open(Window.java:801) at org.talend.dataprofiler.core.ui.action.AbstractMetadataCreationAction.run(AbstractMetadataCreationAction.java:65) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) {code} if on linux, will throw exception like this: {code} Connection failure. You must change the Database Settings. java.sql.SQLException: JZ0I5: An unrecognized CHARSET property was specified: UTF-8. {code}5
613TDQ-6160Ensure that the hive profiling feature still works after TDI-22130NULL5
614TDQ-6166Deleted connections still show up in Connections viewdb connections that have been deleted under dq repo, are still available in the connection view under data explorer perspective13
615TDQ-6167Newly added JDBC driver doesn't show up in the DB Type dropdown - can't connect to DB under Data Explorer perspectivei added a new JDBC driver (vertica) in preferences (talend -> data explorer --> jdbc drivers), it doesn't show up as the DB type when i try to create a new connection i'm able to connect to vertica using the 'generic jdbc' driver and add the connection under Metadata. this allows me to view the db objects (tables, columns, data) in the profile perspective. however, in the data explorer perspective i am unable to connect to my vertica db connection. the error i get in a popup is "Cannot connect to <db_connection_name>/<user>. Check your URL"8
616TDQ-6168Unable to create analysis in TDQThis is a reasonably fresh Studio installation, and I am trying to create a column analysis on a MySQL database on the local machine. The analysis never opens, I get an error in the editor window with the stack trace below. This happens both when I try to create the DB connection in the Profiling perspective and in the Integration perspective. I tried deleting and re-creating the DB connection in all sorts of ways, to no avail. Stack trace: java.lang.ClassCastException: org.talend.core.model.metadata.builder.connection.impl.ConnectionImpl cannot be cast to org.talend.core.model.metadata.builder.connection.DelimitedFileConnection org.talend.dq.nodes.DFConnectionRepNode.<init>(DFConnectionRepNode.java:56) org.talend.dq.nodes.DFConnectionFolderRepNode.getChildren(DFConnectionFolderRepNode.java:79) org.talend.dq.helper.RepositoryNodeHelper.getModelElementFromFolder(RepositoryNodeHelper.java:1731) org.talend.dq.helper.RepositoryNodeHelper.getConnectionRepositoryNodes(RepositoryNodeHelper.java:1563) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.reloadDataproviderAndFillConnCombo(AbstractAnalysisMetadataPage.java:392) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.createConnBindWidget(AbstractAnalysisMetadataPage.java:271) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createAnalysisColumnsSection(ColumnMasterDetailsPage.java:274) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createFormContent(ColumnMasterDetailsPage.java:234) org.eclipse.ui.forms.editor.FormPage$1.run(FormPage.java:152) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.forms.editor.FormPage.createPartControl(FormPage.java:150) org.eclipse.ui.forms.editor.FormEditor.pageChange(FormEditor.java:471) org.talend.dataprofiler.core.ui.editor.CommonFormEditor.pageChange(CommonFormEditor.java:231) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.pageChange(AnalysisEditor.java:190) org.eclipse.ui.part.MultiPageEditorPart.setActivePage(MultiPageEditorPart.java:1067) org.eclipse.ui.forms.editor.FormEditor.setActivePage(FormEditor.java:603) org.eclipse.ui.part.MultiPageEditorPart.createPartControl(MultiPageEditorPart.java:352) org.eclipse.ui.internal.EditorReference.createPartHelper(EditorReference.java:670) org.eclipse.ui.internal.EditorReference.createPart(EditorReference.java:465) org.eclipse.ui.internal.WorkbenchPartReference.getPart(WorkbenchPartReference.java:595) org.eclipse.ui.internal.EditorReference.getEditor(EditorReference.java:289) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditorBatched(WorkbenchPage.java:2863) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditor(WorkbenchPage.java:2768) org.eclipse.ui.internal.WorkbenchPage.access$11(WorkbenchPage.java:2760) org.eclipse.ui.internal.WorkbenchPage$10.run(WorkbenchPage.java:2711) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2707) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2691) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2674) org.talend.dataprofiler.core.CorePlugin.openEditor(CorePlugin.java:312) org.talend.dataprofiler.core.ui.wizard.analysis.AbstractAnalysisWizard.openEditor(AbstractAnalysisWizard.java:92) org.talend.dataprofiler.core.ui.wizard.analysis.column.ColumnWizard.openEditor(ColumnWizard.java:126) org.talend.dataprofiler.core.ui.wizard.AbstractWizard.performFinish(AbstractWizard.java:70) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.dataprofiler.core.ui.action.actions.CreateNewAnalysisAction.run(CreateNewAnalysisAction.java:112) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:126) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) 8
617TDQ-6182Create version 5.2.0RC1 in Babili and populate itNULL2
618TDQ-6184in remote project the refresh icon will not refresh the Recycle bin.1. create two user aa and bb, both aa and bb have read-write rights to the remote project "pro1" 2. aa and bb user logon on the "pro1" at the same time. 3. aa delete an analysis to Recycle bin, refresh the Repository on bb side, the deleted analysis won't show in bb's Repository, but also won't show in Recycle bin. but if now bb want to create an analysis, just set same name with deleted one, so can not successfully, but he can not also see the existed one. note: restart studio, the analysis will show in Recycle Bin.5
619TDQ-6185rename report folder, get some redudant folders .1. logon remote project, create a folder under Reports nodes. 2. try to rename it to a new name, the new folder get, but at the same time get some redundant folders and the old folder name under it(sometimes need to refresh Repository to show the redundant folder) in fact I also reproduce this on local project, but now can not, just reproduced on remote project. besides, pay attention to the move function of report and folder under Report. 13
620TDQ-6186Pattern Test view does not work with HiveUse a hive connection to test pattern. The generated query is invalid. For instance, it is SELECT 'Bejin' REGEXP '^[A-Z]*$' ; The returned error is java.sql.SQLException: Query returned non-zero code: 11, cause: FAILED: Parse Error: line 1:23 cannot recognize input near ''^[A-Z]*$'' ';' '<EOF>' in constant5
621TDQ-6193Pattern frequency indicator drill down function -- "generate regex pattern" can not workrun column analysis with pattern frequency indicator turn to result page, visit drill down function -- "generate regex pattern" will get this error {code} java.lang.UnsupportedOperationException at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createExtendedControl(CreatePatternWizardPage1.java:91) at org.talend.dataprofiler.core.ui.wizard.MetadataWizardPage.createControl(MetadataWizardPage.java:218) at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createControl(CreatePatternWizardPage1.java:56) at org.eclipse.jface.wizard.Wizard.createPageControls(Wizard.java:170) at org.eclipse.jface.wizard.WizardDialog.createPageControls(WizardDialog.java:734) at org.eclipse.jface.wizard.WizardDialog.createContents(WizardDialog.java:606) at org.eclipse.jface.window.Window.create(Window.java:431) at org.eclipse.jface.dialogs.Dialog.create(Dialog.java:1089) at org.talend.dataprofiler.core.ui.utils.OpeningHelpWizardDialog.create(OpeningHelpWizardDialog.java:65) at org.eclipse.jface.window.Window.open(Window.java:790) at org.talend.dataprofiler.core.pattern.actions.CreatePatternAction.run(CreatePatternAction.java:123) at org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory.createPattern(ChartTableFactory.java:474) at org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory$1$2.widgetSelected(ChartTableFactory.java:178) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}1
622TDQ-6194"Analyze duplicate" option doesn't appear on a table analysis with join conditionUsually, when the DQ rule contains a join clause and there are more analyzed data in the joint than in the analyzed table, a new menu appears "Analyze duplicate". In the attached analysis, the rows of the join (7 rows)are more than the rows of the analyzed table (6 rows) because the columns used in the join contain duplicate values. But when I right click the join results, I don't have the "analyze duplicate" option, see attached capture. I think this option should appear whenever the rows of the join are more than those of the analyzed table.8
623TDQ-6200After switch context of a connection, the reload the table schema doesn't work wellcreate a DB connection, export context configured two context params group, has the same server but different catalog group A -- catalog A, group B -- catalog B, default is A the do switch context function, and reload this connection manually the catalog should change to B, file connection: switch context function sometimes will throw an NPE if success switch, after switch context, click "guess schema" function to reload table schema sometimes will throw an NPE {code} java.lang.NullPointerException org.talend.dataprofiler.core.ui.action.actions.SwitchContextAction.run(SwitchContextAction.java:69) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:127) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}20
624TDQ-6203Data Quality - Retrieve Schema "corrupts" Analysis Hi! DQ Project with one metadata database connection specified and one Data Profiling - Column Analysis created, analysing one of the tables. From the Integration Perspective, we choose to retrieve (unchanged) schema, and select all. Then we go to Profiling Perspective and open the Column Analysis -> all the columns have disappeared from the GUI. Tool needs to display warning message to user when retriving all schemas, since existing analysis will become unusable (and very difficult to repair). For more detailed information, please see attached Word document.5
625TDQ-6204 the move folder which contains items function doesn't change the client tag value in remote project1. logon a remote project. 2. create an analysis in folder 'a' 3. try to move folder 'a' to folder 'b', after finished check the client tag in dbconnection, it is still the older one, doesn't contains the 'b' part. do same operation for a norminal dbconnection, after this, check the "<analysedElements xsi:type="relational:TdColumn"" part in analysis file, it is also the older one, we should change the dependency information correctly. also check other kinds of dependency please. work well on local project.8
626TDQ-6207lost imported connectionHave a 5.2 workspace with some mysql and hive connections and analyses. Make sure that the password of root of your mysql database is a private password (avoid toor, root...) Then import the items from TDQ-6194 https://jira.talendforge.org/secure/attachment/47671/table_analysis_with_join_condition.zip Open the analysis TableAnalysis_with_JoinCondition Go in the results tab and right click on the #match: First, we got the following exception java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Access denied for user 'root'@'localhost' (using password: YES) which is expected, but there should be a pop-up to warn the user. Second, edit the connection item and set the correct password. Save and go back to the analysis. The exception still exists. Close the analysis and reopen the analysis. I've got several exceptions and the connection is lost. It's not anymore in my repository. I've checked the filesystem. The connection is not here. It has been deleted! java.sql.SQLException: Invalid URL: jdbc:mysql://localhost:3306/my_person_joins?noDatetimeStringSync=true org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:67) org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104) java.sql.DriverManager.getConnection(DriverManager.java:582) Why do we try to connection with the Hive driver to a mysql connection? java.lang.RuntimeException: java.lang.RuntimeException: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown database 'my_person_joins' org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.getConnection(ExtractMetaDataUtils.java:655) Now the connection is deleted. See attached log for more details. Build: Talend-Studio-r90934-V5.2.0NB8
627TDQ-6211Missing range indicatorSee attached screen capture. In previous version (4.1.2 in the attached picture), the range was computed and displayed in the result tab. Now, it's not. Please, fix the issue. 5
628TDQ-6224Export babili translations into trunk of SVNNULL2
629TDQ-6227migrate oracle datamart failed try to migrate the lower version oracle datamart(4.1.x,4.2.x) to current version, but faild. 8
630TDQ-6232Generate auto-configured analysis from tables (or columns)h3. UI level : - add a menu on the table node in the DQ repository view (DB table or file table) called: "Guess column analysis" - add the same menu on the contextual menu when selecting a set of columns h3. backend level - the action of this menu will do the following: ## get the semantic of the columns ## find concepts in ontology repository with similar semantics ## select indicators that can apply to the columns given their semantic and the information stored in the semantic repository ## set thresholds in indicators whenever possible 13
631TDQ-6233the result for invalid items about Benford Law Frequency is not correct in sql mode.* BUG 1 1. create a column analysis , add Benford Law Frequency indicator. 2. check the result, the invalid result is not correct in sql mode. java is correct. for the sql mode, check the "View executed query" result: SELECT cast(LEFT(`NAME`,1) as char), COUNT(*) c FROM `dba`.`data_benford_law` t GROUP BY LEFT(`NAME`,1) order by LEFT(`NAME`,1) LIMIT 10 what the "limit 10" mean. * BUG 2 beside. for sybase user the indicator, can not get any result, just get error(in Details tab) * BUG 3 View row of "invalid" always gives empty result. 8
632TDQ-6235Benford law indicator - make the color as red in statistics table of anaysis result page NULL1
633TDQ-6236modify the duplicate analysis, the old analysis is modified tooduplicate an analysis (A) with a where condition then delete the where condition from the duplicated one(Copy_A), the old analysis(A) where condition is deleted too8
634TDQ-6237the rename folder function change the 'path' to uncorrect result1. create a dbconnection in a folder. 2. rename the folder, check the value of path "path="metadata/connections/dd/aa"/" should not show the metadata/connections/ this issue also exist on other kinds of items13
635TDQ-6241generate basic report about column analysis just get a blank content filegenerate a report with a column analysis, basic type. check the generated report file, no any content in it. no error, any datamart can reproduce there is no 513 build these days, please dev check the root reason, and verify this issue exist on 513 or not, thanks.8
636TDQ-6242overview report can not generate successfully with hsql db.1. try to generate a overview report with hsql db, but get error. error attached on details tab please dev check the root reason, and make sure this issue exist on 513 or not, we can get TDQ build recent day, do can not check, thanks5
637TDQ-6243the blank count result for sybase is incorrect, the result is always 0the blank count result for sybase is incorrect. the result is always 08
638TDQ-6244Fix unrecognized median indicator definition issue on branch 5.1 and 5.0 - related to TDQ-5381on branch 5.1 the new created is correct the migrated median indicator is still "unrecognized" branch 5.0 the new indicator and migrated both are "unrecognized"2
639TDQ-6252TOP should not try to connect to the analyzed database during report generation, if the "Refresh" option is not checked for this analysis.When the "Refresh" option is not checked for this analysis, the report is generated based on the stored results in the analysis, database connection is not needed.8
640TDQ-6253Cannot create patternTry the "New Regex Pattern" menu in Libraries/Pattern/Regex folder or subfolders. It gives the exception: java.lang.UnsupportedOperationException at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createExtendedControl(CreatePatternWizardPage1.java:91) at org.talend.dataprofiler.core.ui.wizard.MetadataWizardPage.createControl(MetadataWizardPage.java:218) at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createControl(CreatePatternWizardPage1.java:56) at org.eclipse.jface.wizard.Wizard.createPageControls(Wizard.java:170) at org.eclipse.jface.wizard.WizardDialog.createPageControls(WizardDialog.java:734) at org.eclipse.jface.wizard.WizardDialog.createContents(WizardDialog.java:606) at org.eclipse.jface.window.Window.create(Window.java:431) at org.eclipse.jface.dialogs.Dialog.create(Dialog.java:1089) at org.talend.dataprofiler.core.ui.utils.OpeningHelpWizardDialog.create(OpeningHelpWizardDialog.java:65) at org.eclipse.jface.window.Window.open(Window.java:790) at org.talend.dataprofiler.core.pattern.actions.CreatePatternAction.run(CreatePatternAction.java:123) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 5
641TDQ-6259Results of analysis with email JUDI are lostCreate a column analysis with the Email Java UDI. Run the analysis. See the results. Restart the studio, open the analysis. Switch to the result tab, it's empty: all results are set to 0. 5
642TDQ-6261open the "Configuration wizard" on double click on the tMatchGroup componentNULL8
643TDQ-6265Can not unfold columns in Data Explorer perspective after some actions1.create a new connection with mysql tbi 2.unfold all columns under table 'customer' in DQ perspective 3.turn to Data Explorer perspective, open the Database Structure view,Generate 2 sql under table 'customer' by the context menu,they run well on sql editor. 4.close all editor in Data Explorer perspective,turn to DQ perspective and unfold table 'customer'. 5.turn to Data Explorer perspective,try to unfold table 'employee' or others,will be fail and get an error: java.lang.NullPointerException at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.privateGetJDBCMetaData(SQLDatabaseMetaData.java:1571) at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.getColumnInfo(SQLDatabaseMetaData.java:1469) at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.getColumnInfo(SQLDatabaseMetaData.java:1497) at net.sourceforge.sqlexplorer.dbstructure.nodes.TableNode.getColumnNames(TableNode.java:146) at net.sourceforge.sqlexplorer.dbstructure.nodes.ColumnFolderNode.loadChildren(ColumnFolderNode.java:92) at net.sourceforge.sqlexplorer.dbstructure.nodes.AbstractNode.load(AbstractNode.java:337) at net.sourceforge.sqlexplorer.dbstructure.nodes.AbstractNode.getChildNodes(AbstractNode.java:129) at net.sourceforge.sqlexplorer.dbstructure.DBTreeContentProvider.getChildren(DBTreeContentProvider.java:50) at org.eclipse.jface.viewers.AbstractTreeViewer.getRawChildren(AbstractTreeViewer.java:1354)1
644TDQ-6271Hide data of small groups in tMatchGroup configuration wizardWhen we click on "hide groups less than X items", the data currently don't change. They should change according to the displayed groups. 8
645TDQ-6272Create version 5.2.0RC2 in Babili and populate itNULL2
646TDQ-6286fix the problem of connection field in analysis editorsteps to reproduce: 1. prepare environment and import the item package of TDQ-6207 2. open the imported analysis, the connection field shows the first one of all in alphabetical order3
647TDQ-6287fix the issue when we save a modified connection in DI perspectiveIn the context of TDQ-6207, if we 1. open a dbconnection editor 2. switch to DI perspective 3. modify and save 4. switch back to Profiler perspective Then if I modify the name of the connection and save. ex: from AA to BB, but the repository node is not renamed following this operation. Continue to change from BB to CC, the repository node is now renamed to BB but not CC. 8
648TDQ-6290Simplify manual installation of DQ Portalcreate "install.sh" script. This script is at the root of the DQ portal zip. Execute it with the following command: sh install.sh then follow the instructions (the script displays the required parameters, run it again with the appropriate parameters). 3
649TDQ-6291for the structure can not show correctly for sybase.1. in my sybase database, have two login name : a1(default catalog-catalogA), a2. two catalog: catalogA, catalogB. schema under catalogA:schemaA(a1), schema under catalogB: schemaB(a2). 2. try to create a sybase connection:with userName:a1, with no "Database" set--so two catalogs show. 3. check the schema under the two catalogs, schemaA show under the two catalogs, just should show under catalogA. schemaA show under catalogB with no tables 4. if we create the dbconnection set the catalog, the schema will just show under its own catalog. 13
650TDQ-6303import udi indicator of test2.csv, can't get the warning information and the "finish" button can't enabled too.About the test case TDQQA-2952:Import indicators when import the attachment file "test2.csv",you should see an warning in the dialog header saied ' Some value are not be surrounded by quotation marks' and see an text field with warning icon in the preview table and the 'finish' should "enabled.",but there is no warning showned in the import dialog, and the 'finish' button is ok.3
651TDQ-6308In UDI selection dialog uncheck a udi or button deselect all doesn't workin UDI selection dialog, uncheck one udi or click button "deselect all" to remove the udi editor didn't change to "dirty", means disable to save reopen the editor, it's still there3
652TDQ-6313Export babili translations into trunk of SVNNULL2
653TDQ-6318for the top and tdq can not show same structure of sqlserver1. create a sqlserver connection on tdq, set the catalog filter. 2. after finished.check the schema under the catalog. 2. do step 1-2 on top. the schema under the catalog is defferent on top and tdq2
654TDQ-6323improve description fields in Detail viewCarriage return are not well rendered in the detail view. Expand the description field over several lines in order to be able to display correctly the description with several lines. 5
655TDQ-6329In column set analysis editor, remove pattern by the pattern selection dialog will keep icons in column set analysis remove some patterns by the pattern selection dialog pattern labels are removed but the icon keeps.. and click those icon will get this error {code} org.eclipse.swt.SWTException: Widget is disposed at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.SWT.error(SWT.java:3969) at org.eclipse.swt.widgets.Widget.error(Widget.java:468) at org.eclipse.swt.widgets.Widget.checkWidget(Widget.java:340) at org.eclipse.swt.widgets.Widget.getData(Widget.java:554) at org.talend.dataprofiler.core.ui.editor.composite.AbstractColumnDropTree.openIndicatorOptionDialog(AbstractColumnDropTree.java:306) at org.talend.dataprofiler.core.ui.editor.composite.AbstractColumnDropTree$1.mouseDown(AbstractColumnDropTree.java:143) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:185) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}8
656TDQ-6343Create version 5.2.0 in Babili and populate itNULL2
657TDQ-6347three pattern show as 'null' after restart the studio.1. open the TOP project. 2. exit, reopen. the pattern show as 'null'3
658TDQ-6348make sure the "refresh" unchecked, the generated report file will show one item more times.1. create a report file , check the refresh check box unchecked. 2. generate the report file, for the N times you generated, the items will show N times. refer to the attached pdf this not only exist on column analysis report, but other kinds of analysis. please find the root reason, and also make sure work well when the item checked.3
659TDQ-6351Export babili translations into trunk of SVNNULL2
660TDQ-6356can not create sqlserver connection without user/passwd1. try to create a sqlserver connection with "Microsoft SQL Server" selection in the wizard, 2. just put the server information. 3. click check "ok" both on tdq and top. 4. finished, ok on top, failed on TDQ(get error). on TOP can create analysis, but failed to run. get error,same error on tdq, attached to "Details" tab. work well on top 92510-5.1.23
661TDQ-6360after the ETL generated, the analysis can not run .1. create a column analysis. select some indicator and pattern. run. 2. turn to analysis result page, right click on the Unique/Distinct/Duplicate count t->"Remove deduplicate". generate a job, run it, turn back to dq, re-run then anaysis get error(you can also right lick on pattern, to get invalid/valid data job): !ENTRY org.talend.platform.logging 4 0 2012-10-23 18:08:16.120 !MESSAGE 2012-10-23 18:08:16,119 ERROR org.talend.dq.analysis.ColumnAnalysisSqlExecutor - No schema found for columnstuAddress reopen the analysis, all columns gone, restart studio doesn't work. try to unfold a table which doesn't load before get error. attached on "Details" tab. for developer, please investigate the root reason, and check whether reproduce on other branch, I can not get build for other branch now, thanks very much. 2
662TDQ-6372Remove duplicate job one issue: if one table name exist under two different catalog, when try to "remove duplicate" or "get invalid job" can not get the structure correctly.NULL1
663TDQ-6375Change the column analysis editor to display the dataSee attached Mockup.20
664TDQ-6384Refactor the magic class DBConnectionFillerImpl In DBConnectionFillerImpl.java, take fillSchemaToCatalog() method as an example: {code:java} fillSchemaToCatalog(Connection dbConn, DatabaseMetaData dbJDBCMetadata, Catalog catalog, List<String> schemaFilter) {code} Currently every type of database will call this method, in it's body, there are many if/else to adapt database types. such as {code:java} if(dbJDBCMetadata instanceof SybaseDatabaseMetaData) if (!(MetadataConnectionUtils.isPostgresql(dbJDBCMetadata) || MetadataConnectionUtils .isSybase(dbJDBCMetadata))) { if (MetadataConnectionUtils.isMssql(dbJDBCMetadata) && dbJDBCMetadata.getDatabaseMajorVersion() > 8 && dbJDBCMetadata.getDriverMajorVersion() > 1) { {code} This is really bad code design, we need a better class hierarchy design pattern for this to meet all database type's needs. 13
665TDQ-6389for the sqlserver and postgresql connection can not show the structure correctly.1. create a postgresql/sqlserver connection set or not set the catalog parameter(doesn't set the schema). 2. check the structure, only one schema show under each catalog. in fact I have several. please check it same issue as informix db.8
666TDQ-6395rename the dbconnection function doesn't work well1. on dq perspective, create four dbconnections, named 'a','b','c','d' 2. create column analysis about 'b' and 'c' named 'b_analysis' and 'c_analysis', analysis can run well. 3. change to DI perspective, double click any dbconnection, to open the db configure wizard, just click 'cancel', no need to change anything. 4. back to dq, change the name of 'b' connection to 'bb', successfully. 5. reopen the b_analysis, can not show the dbname correctly, not 'bb' just a,c or d. issue 2: 6. turn to di, change the 'c' name to 'cc'. 7. back to dq, reopen 'c_analysis', the items gone. find this issue also on r93147-5.1.3 please dev check the root reason, and check 5.0.4 exist or not, we doesn't have 5.0.4 recent build. thanks. top seems ok. 8
667TDQ-6435tMatchGroup configuration wizard fails to refresh when using context variables in input componentThe tMatchGroup configuration drops an error when using context variables in the input component when you click on refresh button in the wizard. see screenshot for detailed description.3
668TDQ-6424Email validation new UDI does not launch in an analysisI add the email validation udi in an column anaylis on an email data (the one in cust data examples of the DQDEMO project). The analysis does not even run. State is null. see screenshots.3
669TDQ-6434Not Possible to view Source Files like .sqlNot Possible to view Source Files like .sql See ScreenShot 5
670TDQ-6430DQ Hive Profiling - Column Analysis progress bars do not show any textSee attached. 2
671TDQ-6429New Indicator Name is InconsistentAs show in this screen shot, the new e-mail validation indicator has different names, depending upon whether it is on the Exchange or in the studio.1
672TDQ-6421DQ Studio - profiling HIVE 100% CPURunning an overview analysis for a Hive connection on OSx and Unix causes 100% utilization for Studio.8
673TDQ-6407hide the Hortonworks connection from the TOS DQAs the embedded mode is not working for profiling, we need to hide the hortonworks menu from the combo list when we are in TOS DQ. (We must still keep the menu when we are in TDQ) Same thing for the "embedded" mode of Cloudera. 5
674TDQ-6411Upgrade jasper report libraryThe current version of iReport is 4.0.2. Upgrade the jasper libraries and check that all TDQ reports still work. 8
675TDQ-6417cannot run analysis on hsqldb in TOS DQRun the 5.2.0 DQ portal. Connect to the tdqportal hsql database from TOS DQ. See attached item file. try to run an overview analysis. It fails because of an exception (see details tab).5
676TDQ-6437Fix NPE in TUP-273 (recycle bin deletion issue)NULL13
677TDQ-6438Unreadable parameters in UDISee attached capture. 1. When the focus is on an existing field, the text is duplicated. This is a minor issue, but it's confusing. 2. when you edit a parameter, it would be useful to switch to the next field with the "tab" key. 3
678TDQ-6439Create version 5.2.1 in Babili and populate itNULL2
679TDQ-6441Export babili translations into 5.2 branch of SVNNULL2
680TDQ-6445increase synonym result table size when in full screenThe current result table does not fit the window when the view is in full screen. It must. See screen capture.2
681TDQ-6450time analysia can not show the relationship when one varchar value just have one datetime corresponding1. create a time correlation analysis with address+date column. 2. run no data show in the result chart. refer to the pic. I also have attached the table used. use data from tbi->bith_date + position_title is ok.1
682TDQ-6455mssql database compare several times will check failed and cannot do compare anymorecreate a mssql database connection, do several times database compare will pop up a dialog says: check connection failure ... and throw this error {code} java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(Unknown Source) org.talend.cwm.compare.ui.actions.PopComparisonUIAction.run(Unknown Source) org.talend.cwm.compare.ui.actions.SubelementCompareAction.openComparisonEditor(Unknown Source) org.talend.cwm.compare.ui.actions.SubelementCompareAction.run(Unknown Source) org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.performCompareAction(Unknown Source) org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.access$1(Unknown Source) org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer$CompareMouseListener.mouseDoubleClick(Unknown Source) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: org.eclipse.emf.ecore.resource.impl.ResourceSetImpl$1DiagnosticWrappedException: org.eclipse.emf.ecore.xmi.IllegalValueException: Value 'orgomg.cwm.resource.relational.impl.CatalogImpl@4d1d5468 (name: rootdb, visibility: vk_public) (defaultCharacterSetName: null, defaultCollationName: null)' is not legal. (platform:/resource/TOP_DEFAULT_PRJ/metadata/connections/.refreshccccccccccccccccccccccccccccccccccc.comp, -1, -1) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.handleDemandLoadException(ResourceSetImpl.java:315) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.demandLoadHelper(ResourceSetImpl.java:274) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.getResource(ResourceSetImpl.java:397) org.talend.dq.writer.EMFSharedResources.getResource(Unknown Source) org.talend.cwm.compare.factory.comparisonlevel.TableViewComparisonLevel.createTempConnectionFile(Unknown Source) org.talend.cwm.compare.factory.comparisonlevel.AbstractComparisonLevel.popComparisonUI(Unknown Source) org.talend.cwm.compare.ui.actions.PopComparisonUIAction$1.run(Unknown Source) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 35 more Caused by: org.eclipse.emf.ecore.xmi.IllegalValueException: Value 'orgomg.cwm.resource.relational.impl.CatalogImpl@4d1d5468 (name: rootdb, visibility: vk_public) (defaultCharacterSetName: null, defaultCollationName: null)' is not legal. (platform:/resource/TOP_DEFAULT_PRJ/metadata/connections/.refreshccccccccccccccccccccccccccccccccccc.comp, -1, -1) org.eclipse.emf.ecore.xmi.impl.XMLHandler.setFeatureValue(XMLHandler.java:2663) org.eclipse.emf.ecore.xmi.impl.XMLHandler.handleForwardReferences(XMLHandler.java:1149) org.eclipse.emf.ecore.xmi.impl.XMLHandler.endDocument(XMLHandler.java:1228) com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endDocument(Unknown Source) com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source) com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source) com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(Unknown Source) org.eclipse.emf.ecore.xmi.impl.XMLLoadImpl.load(XMLLoadImpl.java:181) org.eclipse.emf.ecore.xmi.impl.XMLResourceImpl.doLoad(XMLResourceImpl.java:180) org.eclipse.emf.ecore.resource.impl.ResourceImpl.load(ResourceImpl.java:1494) org.eclipse.emf.ecore.resource.impl.ResourceImpl.load(ResourceImpl.java:1282) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.demandLoad(ResourceSetImpl.java:255) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.demandLoadHelper(ResourceSetImpl.java:270) ... 41 more Caused by: java.lang.IndexOutOfBoundsException: targetIndex=1, size=1 org.eclipse.emf.common.util.BasicEList.move(BasicEList.java:664) org.eclipse.emf.common.notify.impl.NotifyingListImpl.doMove(NotifyingListImpl.java:1335) org.eclipse.emf.common.notify.impl.NotifyingListImpl.move(NotifyingListImpl.java:1320) org.eclipse.emf.ecore.xmi.impl.XMLHelperImpl.setValue(XMLHelperImpl.java:1195) org.eclipse.emf.ecore.xmi.impl.XMLHandler.setFeatureValue(XMLHandler.java:2658) ... 57 more {code}8
683TDQ-6456the inform information is not correct when try to rename an analysis to an existing one.1. create an analysis named 'aa' 2. create another analysis named 'bb' 3. open 'bb', try to rename to 'aa' get infrom dialog This physical file("bb") already exists! Check if it's in the Recycle Bin or another folder. I think we should not show 'bb' it, should be 'aa' test on V5.2.1NB-r93900,V5.1.3NB-r93897,V5.0.4NB-r939001
684TDQ-6457add generate job menu in the result chart of column set analysisNULL5
685TDQ-6458Fail to add dependeces when select analysis in report editor1.create a column analysis 2.create a report by context menu on "Reports" folder node 3.in the report editor,click "select analyses" and select an analysis then save. 4.open the report file,can't see the tag "<clientDependency...>"; open the analyis file,can't see the tag "<client>". if generate a report by context menu on analysis node,it will be ok.8
686TDQ-6467System pattern -- "Email Address" get different result between SQL engine and Java enginesystem resource -- Pattern -> Regex -> internet -> Email Address run with column analysis on SQL engine and Java engine get the different result take a look at the screen shot5
687TDQ-6468upgrade the hive libraries to 0.9.0NULL5
688TDQ-6469Can not generate report1.create a column analysis 2.create a report based on this analysis 3.set the datamart,then click generate report button,get a NPE,and the report doc is empty: java.lang.NullPointerException at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:108) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:156) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:140) at org.talend.dq.analysis.ReportExecutor.execute(ReportExecutor.java:58) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.runReport(ReportDocGenerator.java:335) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:185) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:120) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)2
689TDQ-6471DQ rule analysis generate a job to get valid/invalid rows, the generated sql is incorrectthe generated job by DQ rule analysis can not run well because the sql is incorrect it like this: "SELECT [..,..] FROM tablename WHERE (( [Conditions] )) WHERE " the last "where" is needless2
690TDQ-6472try to duplicate a parser rule, no actions1. create a parser rule. 2. right click it, try to duplicate one. no actions.8
691TDQ-6478connection analysis about oracle/teradata db get error1. create an oracle/teradata connection analysis. 2. create a connection analysis about this connection. the analysis run get error and the progress bar seems different with before. test on build r94135-5.1.3 this issue doesn't show.1
692TDQ-6480Benford Law Frequency indicator chart doesn't show the column which data is zero in generated report fileBenford law frequency indicator chart in report file is incorrect if the column contains no data, it will not show in report for eg: the "3", "4" column is 0.0%, then these two columns will not appear in report document5
693TDQ-6481SQL syntax error when use tOracleValidRow and tOracleInValidRow Test jobs have been uploaded. Job TestCase_tOracleXXRow_11 obtain throw error: Exception in component tOracleInvalidRows_2 java.sql.SQLSyntaxErrorException: ORA-00933: SQL 命令未正确结束 Job TestCase_tOracleXXRow_connect_11 obtain throw error: Exception in component tOracleValidRows_1 java.sql.SQLSyntaxErrorException: ORA-01741: 非法的零长度标识符 5
694TDQ-6484Refactoring the code of loading jars in Hive embedded modeAfter this TDI-23768 sub-task is finished, we must refacoring code for hive embedded mode. Now it's in a separate execution sequence comparing to standard hive mode.8
695TDQ-6485for oracle open the dbconnection wizard by the "edit" button, do nothing but inform user to reload.issue 1: 1. create an oracle dbconnection set filter or not. 2. create a column analysis about this connection. 3. open the connection editor, click the "edit". then the wizard pop up. change nothing, but click "check" then click "Finish" there will the reload dialog popup--but I didn't change anything. if don't click "check", just click "Finish", no wizard popup issue 2: redo issue 1's step , but for step 3, remove the schema filter in the wizard, then finish the wizard, so all the sachems show. but check the analysis , columns gone. check the first schema--the number behind "Tables" is '0' test on r93900-5.0.4, and r94217-5.1.3, the issue exists. issue 3: for issue 1, if we click check, and during the wizard, we change the name of the connection,then at the pop up dialog we click "reload" , then recheck the analysis, all columns gone. and in the repository still the old name. 5
696TDQ-6487connection analysis about which contains both catalog and schema after execution cannot expand the result automaticallyrun a connection overview analysis which contains both catalog and schema structure cannot expand the result automatically(Statistical information section) and throw an SWT error: {code} org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.IllegalArgumentException: Index out of bounds) at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.IllegalArgumentException: Index out of bounds at org.eclipse.swt.SWT.error(SWT.java:4064) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.SWT.error(SWT.java:3969) at org.eclipse.swt.widgets.Widget.error(Widget.java:468) at org.eclipse.swt.widgets.Table.getItem(Table.java:2496) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractFilterMetadataPage.refresh(Unknown Source) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractFilterMetadataPage.fireRuningItemChanged(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(Unknown Source) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 23 more {code}5
697TDQ-6502Export babili translations into trunk of SVNNULL2
698TDQ-6506after migration,some analysis can not run well1. just migration file from 424 and 503 but the migrated file can not run well. seems most are about oracle. I have attached all the error log file, about each kind of indicator. during the migration no errors. for file from 424 I can migrate to 511 successfully. 8
699TDQ-6507Reduce the number of connection creation when reloading table folder.At AbstractComparisonLevel.reloadCurrentLevelElement() , it will call database connecting low level method many times (4 at least). It can bring really performance issues, optimize it.8
700TDQ-6511fix the issue when "Use an existing connection" (Error ORA-01741)when t<DbName>ValidRows uses ana existing connection, the schema value is contained in the selected t<DbName>Connection component, and the schema in t<DbName>ValidRows is empty. That's why we got "select ... from \"\".\"TableName\" ..." as generated query. Note that for Postgresql database, the schema param is compulsary, we must retrieve this value from the t<DbName>Connection component.5
701TDQ-6512a "generate job" menu appears in Talend Open Studio for Data Qualitya "generate job" menu to extract distinct values from a frequency table is available in a 5.2.1.NB-r93795 community build for data quality. See attached capture. this menu should be available only in subscription builds.3
702TDQ-6516for TOS_DQ the welcome page is still the old one, but for other SE build seem with the new one.we'd better make sure the welcome same as other product, with the new one.3
703TDQ-6519backport to 5.1This parent is TDQ-6287.2
704TDQ-6523make sure the preview function can be used when the connection is hive embedded mode.NULL2
705TDQ-6539Disable the "Run Report" button after clicked and reset to enabled after the report generation is done.The behavior should be like the current "Execute Analysis" button. A known issue if we do not do this: User may double click the button and the indicator values will be inserted twice with the same timestamp, and this will change the final results, ex: all benford percertage results will be divided by 2.5
706TDQ-6549Fix the wrong titleFrom this bug: TDQ-5467 When the analyzed column is filtered out from DQ repository view, it will popup a dialog to notify user that the column is hiding. But the title of this dialog is not correct.1
707TDQ-6550Open warning dialog to user when the SQL expression had been removed from indicator definition when runing the analysisFrom this issue: TDQ-5645 The error will go into error viewer, but it's better to popup a message dialog to notifying. The message can be: "Expression of <database_name> is not found from indicator definition, do you want to add a new expression?" Yes, open definition editor No, do nothing1
708TDQ-6557after create a MDM connection, then edit it, can not reload it againissue1: after create a MDM connection, then edit it(for example: change data-Model, data-Container to Product), can not reload it issue2: note: after duplicate a MDM connection which can be unfolderred, can not unfolder it8
709TDQ-6571Limit result in advance indicator option pannel loose effect on Ingres DB Run the attached analysis and see the analysis result.5
710TDQ-6587rename the FileConnection sometimes, there will throw Exceptionsopen the FileConnection wizard and click cancel first, if open the FileConnection wizard again and modify the name, there will throw Exceptions {code} java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:116) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:98) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.computePagination(ColumnMasterDetailsPage.java:417) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPaginationTree(ColumnMasterDetailsPage.java:368) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createAnalysisColumnsSection(ColumnMasterDetailsPage.java:347) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createFormContent(ColumnMasterDetailsPage.java:237) org.eclipse.ui.forms.editor.FormPage$1.run(FormPage.java:152) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.forms.editor.FormPage.createPartControl(FormPage.java:150) org.eclipse.ui.forms.editor.FormEditor.pageChange(FormEditor.java:471) org.talend.dataprofiler.core.ui.editor.CommonFormEditor.pageChange(CommonFormEditor.java:231) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.pageChange(AnalysisEditor.java:190) org.eclipse.ui.part.MultiPageEditorPart.setActivePage(MultiPageEditorPart.java:1067) org.eclipse.ui.forms.editor.FormEditor.setActivePage(FormEditor.java:603) org.eclipse.ui.part.MultiPageEditorPart.createPartControl(MultiPageEditorPart.java:352) org.eclipse.ui.internal.EditorReference.createPartHelper(EditorReference.java:670) org.eclipse.ui.internal.EditorReference.createPart(EditorReference.java:465) org.eclipse.ui.internal.WorkbenchPartReference.getPart(WorkbenchPartReference.java:595) org.eclipse.ui.internal.PartPane.setVisible(PartPane.java:313) org.eclipse.ui.internal.presentations.PresentablePart.setVisible(PresentablePart.java:180) org.eclipse.ui.internal.presentations.util.PresentablePartFolder.select(PresentablePartFolder.java:270) org.eclipse.ui.internal.presentations.util.LeftToRightTabOrder.select(LeftToRightTabOrder.java:65) org.eclipse.ui.internal.presentations.util.TabbedStackPresentation.selectPart(TabbedStackPresentation.java:473) org.eclipse.ui.internal.PartStack.refreshPresentationSelection(PartStack.java:1254) org.eclipse.ui.internal.PartStack.setSelection(PartStack.java:1207) org.eclipse.ui.internal.PartStack.showPart(PartStack.java:1606) org.eclipse.ui.internal.PartStack.add(PartStack.java:497) org.eclipse.ui.internal.EditorStack.add(EditorStack.java:103) org.eclipse.ui.internal.PartStack.add(PartStack.java:483) org.eclipse.ui.internal.EditorStack.add(EditorStack.java:112) org.eclipse.ui.internal.EditorSashContainer.addEditor(EditorSashContainer.java:63) org.eclipse.ui.internal.EditorAreaHelper.addToLayout(EditorAreaHelper.java:225) org.eclipse.ui.internal.EditorAreaHelper.addEditor(EditorAreaHelper.java:213) org.eclipse.ui.internal.EditorManager.createEditorTab(EditorManager.java:778) org.eclipse.ui.internal.EditorManager.openEditorFromDescriptor(EditorManager.java:677) org.eclipse.ui.internal.EditorManager.openEditor(EditorManager.java:638) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditorBatched(WorkbenchPage.java:2860) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditor(WorkbenchPage.java:2768) org.eclipse.ui.internal.WorkbenchPage.access$11(WorkbenchPage.java:2760) org.eclipse.ui.internal.WorkbenchPage$10.run(WorkbenchPage.java:2711) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2707) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2691) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2674) org.talend.dataprofiler.core.CorePlugin.openEditor(CorePlugin.java:298) org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.duRun(OpenItemEditorAction.java:133) org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction$1.run(OpenItemEditorAction.java:117) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3011) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1851) org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.run(OpenItemEditorAction.java:124) org.talend.dataprofiler.core.ui.utils.WorkbenchUtils.refreshCurrentAnalysisEditor(WorkbenchUtils.java:393) org.talend.dataprofiler.core.service.TOPRepositoryService.refreshCurrentAnalysisEditor(TOPRepositoryService.java:514) org.talend.repository.ui.wizards.metadata.connection.files.delimited.DelimitedFileWizard.performFinish(DelimitedFileWizard.java:360) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.dataprofiler.core.ui.action.actions.EditFileDelimitedAction.run(EditFileDelimitedAction.java:55) org.talend.dataprofiler.core.ui.views.DQRespositoryView$6.mouseDoubleClick(DQRespositoryView.java:463) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:77) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:616) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.NullPointerException org.talend.dataprofiler.core.model.impl.ModelElementIndicatorImpl.getElementName(ModelElementIndicatorImpl.java:778) org.talend.dataprofiler.core.model.impl.DelimitedFileIndicatorImpl.getElementName(DelimitedFileIndicatorImpl.java:40) org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.getModelElemetnDisplayName(AnalysisColumnTreeViewer.java:726) org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.addItemElements(AnalysisColumnTreeViewer.java:514) org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.setElements(AnalysisColumnTreeViewer.java:405) org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:74) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 97 more {code}3
711TDQ-6589Column Content Comparison analysis drill down menu "view match/not match rows" with informix database cannot worktry to visit "view match/not match rows" function of content comparison analysis with informix database connection I got an error dialog says "A syntax error has occurred." and no result same as issue TDQ-6570, the query is wrong5
712TDQ-6610Analysis editor composite will got chaos after execution in DI perspectiverun an analysis in DI perspective turn back to DQ perspective, the composite got be like the screenshot and failed run in DI {code} java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:116) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:98) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPreviewCharts(ColumnMasterDetailsPage.java:600) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.refresh(ColumnMasterDetailsPage.java:628) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:210) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:339) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.NullPointerException at org.talend.dataprofiler.core.ui.views.ColumnViewerDND.installDND(ColumnViewerDND.java:106) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.createTree(AnalysisColumnTreeViewer.java:207) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.setElements(AnalysisColumnTreeViewer.java:389) at org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:69) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 35 more Root exception: java.lang.NullPointerException at org.talend.dataprofiler.core.ui.views.ColumnViewerDND.installDND(ColumnViewerDND.java:106) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.createTree(AnalysisColumnTreeViewer.java:207) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.setElements(AnalysisColumnTreeViewer.java:389) at org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:69) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:116) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:98) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPreviewCharts(ColumnMasterDetailsPage.java:600) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.refresh(ColumnMasterDetailsPage.java:628) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:210) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:339) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}3
713TDQ-6611Fix labels issues in Benford law statisticsSee attached screen capture. 3
714TDQ-6613Change labels of the frequency statistics chartSee attached screenshot. Please, consider the other chart too and feedback to me if you're not sure about the necessity of a change. 3
715TDQ-6617Develop a library for the report generationThis library will read reports, execute analyses, store the data in the data mart and (optionally) generate pdf reports. 20
716TDQ-6620Support Address Validation Vendor LoqateAdd support components for address validation partner Loqate (www.loqate.com) See Steve S. if additional technical API information or technical contacts are needed. Note: the category of this component will be "Data_Quality/Address/Loqate" 13
717TDQ-6633there is no drill down for duplicate cout which analyzed mdm column1. crate a column analysis about mdm connection. 2. make the entity has some duplicate value, so we should get the drill down of duplicate count indicator, run the analysis with java engine, result is correct, but no drill down on table chart, on the pic chart, there is drill down, but can not get any result.13
718TDQ-6645cannot change an option in DQ to not store data in the analysisThe option store data with column set analysis is always checked even you changed and saved it comes back again.2
719TDQ-6654Refactorying http://talendforge.org/trac/top/changeset/95805#file0What is the needed to call this method in Local project? initChildForRemoteProject()1
720TDQ-6658Junit required for r95607NULL2
721TDQ-6664so many warning show in error log when reload the connection setting1.right click on Db connections and select Create connection 2.name it and click next 3.set Db Type as MySQL for example and fill valid connection information click check 4.after check succeeded click finish 5.double click the connection you just created to edit it 6.click "Export as context" or change the db info(such as db name),click check, after check succeeded click finish, you will be asked wether to reload the connection,select reload and click ok result: many warnings shown in error log Warning Thu Dec 27 14:59:31 CST 2012 2012-12-27 14:59:31,692 WARN org.talend.cwm.compare.factory.comparisonlevel.AbstractComparisonLevel - Element not updated: org.talend.core.model.metadata.builder.connection.impl.DatabaseConnectionImpl@524db33c (name: mysql, visibility: vk_public) (properties: {}, id: null, comment: , label: mysql, synchronised: false, divergency: false) (pathname: null, isCaseSensitive: false, version: null, ContextMode: false, ContextId: null, contextName: null) (DatabaseType: MySQL, DriverJarPath: null, DriverClass: org.gjt.mm.mysql.Driver, URL: jdbc:mysql://192.168.30.147:3306/test?noDatetimeStringSync=true, dbVersionString: MYSQL_5, Port: 3306, Username: root, Password: 1QY6ZyNqCD4BAhKeqSkILQ==, ServerName: 192.168.30.147, DatasourceName: , FileFieldName: , SID: test, SqlSynthax: SQL Syntax, StringQuote: ", NullChar: 000, DbmsId: mysql_id, ProductId: MYSQL, DBRootPath: null, AdditionalParams: noDatetimeStringSync=true, StandardSQL: true, SystemSQL: false, cdcTypeMode: null, SQLMode: false, UiSchema: ) Warning Thu Dec 27 14:59:22 CST 2012 NLS unused message: OpenJobScriptAction_OpenEditJobScript_text in: org.talend.metalanguage.jobscript.ui.actions.messages3
722TDQ-6663TableSelectionDialog can not dependency DQRepositoryNode.create an analysis and move to DI perspective. open TableSelectDialog then have DQRepositoryView will openning whether do you have open it before that. should let TableIndicator save node information as ModelElementIndicator This issue is only existed in Table analysis. the problem is that the table selection in table analysis editor will require the DQ perspective being opened. Whereas it should not.5
723TDQ-6672for the low frequency indicator result in report and analysis is different for the sort order1. create an analysis file select the low frequency indicator. 2. generate report about the indicator. 3. check the result the sort order in analysis and report is different. please make sure other low frequency indicator also same(bin low frequency is same now) 5
724TDQ-6674the result page should better change the catalog name to certain UDI name1. create udi file 2. add to column analysis, 3. run analysis. 4. check result on result tab. the name of the udi just show the catalog name but not the certain udi name, we'd better change it: if we have more than one same kind of UDI, how to identify it. 1
725TDQ-6678the report template is not very correct for content compare analysis1. create a content compare comparison analysis, select two column for left(id2,name2) and right(id2, name2) 2. create report about the analysis. 3. generate a basic report, then an evolution report. check the basic: will show 4 table charts, refer to the pic attached, in fact, the analysis get these result by compare left to right as a whole, but in report separate it to several for evolution report: get first and second two pages. if analysis contains only one column, only first page in my opinion only second page is enough. pay attention to dqportal.8
726TDQ-6686overview report generate failed when one table name in my analyzed db has a long name1. create a dbconnection make sure it has a long name table. 2. create a overview report about the connection. 3. generate report, get error. {code} !MESSAGE 2013-01-07 15:00:50,097 ERROR org.talend.dq.persistence.DatabasePersistence - org.hibernate.exception.DataException: could not insert: [org.talend.dataprofiler.datamart.hibernate.TdqOverviewIndvalue] !STACK 0 org.hibernate.exception.DataException: could not insert: [org.talend.dataprofiler.datamart.hibernate.TdqOverviewIndvalue] org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:77) org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) org.hibernate.id.insert.AbstractReturningDelegate.performInsert(AbstractReturningDelegate.java:40) org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2093) org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2573) org.hibernate.action.EntityIdentityInsertAction.execute(EntityIdentityInsertAction.java:47) org.hibernate.engine.ActionQueue.execute(ActionQueue.java:248) org.hibernate.event.def.AbstractSaveEventListener.performSaveOrReplicate(AbstractSaveEventListener.java:290) org.hibernate.event.def.AbstractSaveEventListener.performSave(AbstractSaveEventListener.java:180) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:108) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:186) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:33) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:175) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:27) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:70) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:535) org.hibernate.impl.SessionImpl.save(SessionImpl.java:523) org.hibernate.impl.SessionImpl.save(SessionImpl.java:519) sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.hibernate.context.ThreadLocalSessionContext$TransactionProtectionWrapper.invoke(ThreadLocalSessionContext.java:301) $Proxy19.save(Unknown Source) org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:133) org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.historizeData(ReportDocGenerator.java:450) org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:263) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:126) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: com.mysql.jdbc.MysqlDataTruncation: Data truncation: Data too long for column 'TV_NAME' at row 1 com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3376) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3310) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1853) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1976) com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2503) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1737) com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2022) com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1940) com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1925) org.hibernate.id.IdentityGenerator$GetGeneratedKeysDelegate.executeAndExtract(IdentityGenerator.java:73) org.hibernate.id.insert.AbstractReturningDelegate.performInsert(AbstractReturningDelegate.java:33) ... 25 more {code}3
727TDQ-6687Remove the temporary solution of TDQ-6413 after TDI-24381After TDI-24381 done, we should revert the temporary solution in TDQ-6413.1
728TDQ-6689Export babili translations into 5.1 branchNULL2
729TDQ-6692remove the dialog when change the name of connection and change refresh mode.1.open one analysis editor. 2.open one connection editor. 3.change the name of connection on the connection editor or database Wizard. 4.you will find it. when refresh editor we use close editor then reopen it. but it will come to a bad feel for user. It is better to create a notice to refresh a part of editor. care about modify connection version on the database Wizard it need a refresh too on the analysis editor. 8
730TDQ-6698Create a new tDqReportRun component to execute reports with the new reporting engine libraryThe component may need database connections components in order to be runnable. We may put several tXXXXConnection components on the job editor's canevas for each connection used by the analyses of the report. This will help us to have the required drivers on the classpath of the job. The tDqReportRun will have a table where the user selects the existing connections. This list will be like the "component list" combo box in tMySqlInput. The list of connection components will be configured and placed automatically in the tDqReportRun component with a job generation menu on an existing report in the DQ repository view. But this list will be set manually if the user creates an empty job and drag&drop the 13
731TDQ-6703import the project from TDQ-6676, get NPEjava.lang.NullPointerException at org.talend.dq.helper.PropertyHelper.getPropertyFile(PropertyHelper.java:102) at org.talend.dq.CWMPlugin.addConnetionAliasToSQLPlugin(CWMPlugin.java:147) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter.notifySQLExplorerForConnection(FileSystemImportWriter.java:881) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter.finish(FileSystemImportWriter.java:632) at org.talend.dataprofiler.core.ui.imex.model.ZipFileImportWriter.finish(ZipFileImportWriter.java:63) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter$1.run(FileSystemImportWriter.java:471) at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3010) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1892) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter.write(FileSystemImportWriter.java:481) at org.talend.dataprofiler.core.ui.imex.ImportWizard$1.run(ImportWizard.java:90) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) 5
732TDQ-6705Support the new HDP version (Bimota) 1.2.0NULL8
733TDQ-6753Create version 5.2.2 in Babili and populate itNULL2
734TDQ-6772Avoid DQ repository view crash when the product version cannot being evaluated.NULL1
735TDQ-6807Use the same naming rules as in "TDI-24610 Invalid characters for old metadata items"The metadata item had been finished by @Nicolas, in DQ , all items must be use the same naming rules with metadata items.8
736TDQ-6813Update the Talend Logo everywhereNew Talend logo "Integration at any scale". Update the logo in all places in the studio and in the DQ portal. 3
737TDQ-6834Export babili translations into trunk of SVNNULL2
738TDQ-6837Create version 5.3.0M2 in Babili and populate itNULL2
739TDQ-6841Complete the UDI drill down featureSee the sub-tasks for the remaining issue.8
740TDQ-6844From TDQ-5392 remove GENERATED annotation or add "NOT"When a EMF mothod is going to be modified, must care about the @GENERATED annotation. * {code:java} /** * <!-- begin-user-doc --> * <!-- end-user-doc --> * @generated */ public String getName() { return name; } /** * <!-- begin-user-doc --> normalize the name. <!-- end-user-doc --> * * @generated */ public void setName(String newName) { String oldName = name; name = WorkspaceUtils.normalize(newName); if (eNotificationRequired()) eNotify(new ENotificationImpl(this, Notification.SET, PropertiesPackage.TDQ_FILE_ITEM__NAME, oldName, name)); } {code} Add NOT after @GENTERATED1
741TDQ-6850can not initialize the pattern and rules and source file correctly when load an remote project .1. create a remote project on 521 on one server. 2. migrate the file to another server by Repository Manager(just set the rule as author filter) 3. migrate to new server successfully. 4. try to load the remote project by studio. issue 1(refer to pic and error log): in libraries only indicators show. strange, we have other folder and files in both svn and local machine for the project. I just check by 5.3.0, import pattern to cmdline project, and then export the patterns. check the orgiginal patterns and exported patterns, xmi id changed, surprise. issue2(refer to pic): when log on to the project, the studio sometimes get inform dialog, about indicators and patterns rename. so : what the opportunity dq will initialize the libraries. why xmi id changed under cmdline(should check all kinds of file), 13
742TDQ-6868Export babili translations into 5.2 branch of SVNNULL2
743TDQ-6903Enable contextual Data mart in the report editorThe feature is that we need to be able to use a contextualized connection in the report editor. We need: 0. a new field in the pref page to set the default path of the logo 1. a button in the preference page to export the data mart connection and path information (folder and logo) as a context. 1b. a button in the preference page to revert the context (see the behavior of the database connection revert button). 2. a button in the report editor to attach a context to the report (it will select a context from the repository view). This button is to be added in the context section. 3. run the report with contextual information 4. change the context used by a report 5. export the context information when we export the items The export context action will open the new context wizard. Each variable will start with the report name followed by _. For instance, if the report name is "crm", then the variables will start with "crm_". The variable exported from the preference page only concern the fields available in the preference page: database connection, logo path and folder path. In the report editor, there will be more variables: See attached screen capture "export_context2.png". A "Context" section must be added after the "Database Connection" section in the report editor. In this section, a combo list with the context names will be displayed. The report is executed with the selected context. When there is no context, the combo list is empty. Technically, the EMF context items must be copied into the report item. See how it is done for jobs. {code} <context confirmationNeeded="false" name="ctxt2"> <contextParameter comment="" name="my_AdditionalParams" prompt="my_AdditionalParams?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="noDatetimeStringSync=true"/> <contextParameter comment="" name="my_Server" prompt="my_Server?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value=""/> <contextParameter comment="" name="my_Password" prompt="my_Password?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_Password" value=""/> <contextParameter comment="" name="my_Login" prompt="my_Login?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="root"/> <contextParameter comment="" name="my_Port" prompt="my_Port?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="3306"/> <contextParameter comment="" name="my_Database" prompt="my_Database?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="tbi"/> </context> <context confirmationNeeded="false" name="ctx1"> <contextParameter comment="" name="my_AdditionalParams" prompt="my_AdditionalParams?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="noDatetimeStringSync=true"/> <contextParameter comment="" name="my_Server" prompt="my_Server?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value=""/> <contextParameter comment="" name="my_Password" prompt="my_Password?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_Password" value=""/> <contextParameter comment="" name="my_Login" prompt="my_Login?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="root"/> <contextParameter comment="" name="my_Port" prompt="my_Port?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="3306"/> <contextParameter comment="" name="my_Database" prompt="my_Database?" promptNeeded="false" repositoryContextId="_5E0XkOlxEeKZqs84A3ZGvw" type="id_String" value="tbi"/> </context> {code} (Optional in a first implementation) A. Ideally, if possible, the view Context could be reused to display the context attached to the Report. See with DI team whether it's possible or if the Context view can only be linked to jobs. B. When the repository context is updated, a pop-up should tell whether to propagate the changes. Then the list of impacted reports should be displayed. If the user choose to propagate the changes, a copy of the repository context is done into the report item (same behavior as the DI jobs). 20
744TDQ-6921text indicator can not run correctly for special data1. create a column analysis, add a nvarchar2 type column. 2. add text indicator run the analysis, get error.8
745TDQ-6925Use tools mentioned in the meeting (sleak etc.) to find the resources in DQ projects that are not disposed appropriately before.Create a subtask in TDQ-4268 for each issue found 5
746TDQ-6949Create version 5.3.0M3 in Babili and populate itNULL2
747TDQ-6976Export babili translations into trunk of SVNNULL2
748TDQ-7048Create version 5.3.0RC1 in Babili and populate itNULL2
749TDQ-7050Export babili translations into trunk of SVNNULL2
750TDQ-7079the indicator selection dialog just missed some link on the help content open the indicator selection dialog, check the links. Actual Result: on the two pic, just missed some links Expected Result: should have links for all indicators and can link well.1
751TDQ-7087Create version 5.3.0RC2 in Babili and populate itNULL2
752TDQ-7114Add UK to tQASBatchAddressRowQAS Batch is available for the UK (AFAIK it was originally a UK product) Yet only Luxembourg!, Germany, France and the USA are available from the drop down in the above Talend component. Can this be added please?8
753TDQ-7124Export babili translations into trunk of SVNNULL2
754TDQ-7167Create version 5.3.0 in Babili and populate itNULL2
755TDQ-7169Export babili translations into trunk of SVNNULL2
756TDQ-7192Add an option to only return exact matches in our standardization componentsCurrently, the tSynonymSearch returns EXTRA DEEP BASE when we search for EXTRA REACH. It is not wanted. It relates somehow to TDQ-3608 But the wanted behavior is to only return a match when the search string is EXACTLY found in the index. The technical solution may be to surround the input string with a double quote " or to add a + in front of each word. The input string is the full token extracted by ANTLR (in case of tStandardizeRow). That's not sufficient though: for instance, a search for "RED" would nevertheless return "RED BASE" 3
757TDQ-7247Create version 5.3.1 in Babili and populate itNULL2
758TDQ-7249Create a TUJ for tDqReportRunThis TUJ should test the execution of a report containing several analyses. There should be one analysis of each type and the column analysis should use regex pattern, java udi, and udi. The analyses don't need to be refreshed (uncheck the refresh checkbox in the report editor) so that we don't need to really run the analyses. But the analyses must have run at least once before they are included into the TUJ, so that we get results. The TUJ should test that the execution runs correctly and produces expected results. We should also have a second tDqReportRun component that fails in order to test that the returned execution status is not ok. 2
759TDQ-7298Delete different items only the first one go into recycle binselect two different type items and delete them only the first one in it (actually both of them in) refresh repository the other one in recycle expected result: while do delete all of them should into recycle at the same time actually result: only the first one go into recycle (note: this only exists in 5.3.x)1
760TDQ-7301In the tMatchGroup wizard, the text of the "plus" button isn't correct & the MASTER output column is missing from the matching tableIn the configuration wizard of tMatchGroup: -the text linked to the plus button of the Configuration view reads "New Rule" and it should read "New Configuration" (see attached image) -The columns in the matching table are missing the standard output MASTER column (see attached image)2
761TDQ-7303UI improvement in Match studio1. the different groups cannot be distinguished (see screenshot: all groups use the same green color). We should make the distinction clearer either with some lines or by changing a bit the colors of the groups with the same size. 2. we should remove shadows in the bar chart and use fully colored bars. 8
762TDQ-7310for the jdbc connection still can not preview even if add driver list in the preference--- if driver is add later than db createwant to analyze a dq unsupport db. 1. create a dq unsupport connection with jdbc connection. 2. try to preview , can not . 3. so add driver in the preference 4. preview again, still can not. Expected Result: in step 4, hope can preview ok. Actual Result: in step 4, can not preview. if add driver first, then create connection will be ok.5
763TDQ-7311Enable the user to specialize indicators and patterns for a custom (not supported yet) database By default, the list of supported databases is fixed in the TOS DQ Wizard. Only those databases can be profiled. The user may connect to another database with JDBC, but he can't add the SQL template for his specific database. He can currently only modify the default SQL template in order to support his database. We need to open this list in the indicator and regex editors so that we can add SQL template for specific unsupported yet databases. 8
764TDQ-7323add one check when click "refresh" or "ok" button to check whether current blocking key contain two same column1.create a job and make it use tmatchGroup. 2.open the tmatchGroup Dialog and add two same column on bolcking key table. 3.click "refesh" button will have a exception for compile error. then click "ok" button and run the job will get same issue. 4.we need to add one check when we click both button, if blocking key contain two same column will have a warring dialog to notice user.2
765TDQ-7381Export babili translations into 5.3 branch of SVNNULL2
766TDQ-7407Only display the Cheat Sheet view on new startup of the studioThe default perspective should display only the cheat sheet when it starts. All views (dq repository and detail view) must be closed and the editor part minimized. (picture 1) The cheat sheet place holder should be on the left of the editor part (pic 2) and take 1/4 of the screen. The cheat sheet place holder should be on the left of the DQ repository view and detail view which are on the left of the editor (pic 3). The DQ repository view takes another 1/4 of the screen and the editor the last 1/2. The first time an item is created via the cheat sheet, the DQ repository view and Detail view must open (pic 3). Or when the cheat sheet is closed and the selected perspective is Data Profiling, then the DQ repository view and Detail view must open (pic 4). 5
767TDQ-7416Integrate newest dq portal version (5.1)Integrate newest SpagoBI version in DQ portal. Make all dq portal engines available.5
768TDQ-7418Profiler : Allow variables, like context variablesAllow variables, like context variables, to be valid fields in analysis and report input fields, like date range on where clauses. Today to run a profile over a date start/stop and then change the range requires hard coding and then changing that hardcoded value. Concerned analysis fields: - data filter - number of connections per analysis Concerned report fields: - output folder - output filename - execution date range (start / end) - logo file path Enable context usage of contexts in TOS DQ (only use built-in contexts => no need to display the context node in dq repository view)? is Context view reusable? Adapt the analysis editor to display the context and allow the user to switch between contexts just as in the report editor. Add a separate section "Context group" in the analysis editor AND move the current context of the report editor into a new section too.13
769TDQ-7420run analysis get error with all indicators for informix databaserun a column analysis get error with all indicators for informix database. many of analysis can not run correctly, I guess the following is the reason, not support the ifnull fuction java.sql.SQLException: Routine (ifnull) can not be resolved. at com.informix.jdbc.IfxSqli.a(IfxSqli.java:3449) at com.informix.jdbc.IfxSqli.E(IfxSqli.java:3762) at com.informix.jdbc.IfxSqli.dispatchMsg(IfxSqli.java:2574) at com.informix.jdbc.IfxSqli.receiveMessage(IfxSqli.java:2490) at com.informix.jdbc.IfxSqli.executeExecute(IfxSqli.java:2378) at com.informix.jdbc.IfxSqli.executeExecute(IfxSqli.java:2353) at com.informix.jdbc.IfxResultSet.b(IfxResultSet.java:390) at com.informix.jdbc.IfxStatement.a(IfxStatement.java:1319) at com.informix.jdbc.IfxStatement.executeImpl(IfxStatement.java:1289) at com.informix.jdbc.IfxStatement.c(IfxStatement.java:1005) at com.informix.jdbc.IfxStatement.execute(IfxStatement.java:891) at org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(Unknown Source) at org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(Unknown Source) at org.talend.dq.analysis.ColumnAnalysisSqlParallelExecutor.run(Unknown Source) at org.talend.dq.analysis.ColumnAnalysisSqlExecutor$ExecutiveAnalysisJob.run(Unknown Source) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException at com.informix.util.IfxErrMsg.getSQLException(IfxErrMsg.java:407) at com.informix.jdbc.IfxSqli.E(IfxSqli.java:3767) ... 14 more 5
770TDQ-7443generate report file button can not use the datamart part parameter correctly if first time generate failed1. create a report file. 2. in the report editor set datamart parameter-- set a wrong password other information is correct. 3. generate report file, get inform dialog: username or passwd is not correct. 4. change passwd to correct one,save, regenerate report file. Actual Result: still get inform dialog. Expected Result: generate report file correctly. note: reopen report work well. if first set correct,work well, then change to a wrong one, will get inform dialog.----correct3
771TDQ-7453tDqReportRun component can not run-- report with oracle overview analysis1. create an overview analysis about oracle. 2. create a report about the analysis. 3. generate the report file, work well. 4. right click on the report->Launch a report. 5. run the generated job. Actual Result: will get error, job can not run well. Expected Result: job should run well. and generate doc well. {code} org.talend.dq.analysis.AnalysisExecutor -1193 [main] INFO org.talend.dq.analysis.AnalysisExecutor - Connection to oracle Exception in thread "main" java.lang.ExceptionInInitializerError at org.talend.core.model.metadata.DBConnectionFillerImpl.fillTables(DBConnectionFillerImpl.java:1025) at org.talend.core.model.metadata.MetadataFillFactory.fillTables(MetadataFillFactory.java:192) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadTables(DqRepositoryViewService.java:345) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(DqRepositoryViewService.java:195) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(DqRepositoryViewService.java:204) at org.talend.dq.indicators.AbstractSchemaEvaluator.evalSchemaIndicLow(AbstractSchemaEvaluator.java:460) at org.talend.dq.indicators.AbstractSchemaEvaluator.evalSchemaIndic(AbstractSchemaEvaluator.java:426) at org.talend.dq.indicators.ConnectionEvaluator.executeSqlQuery(ConnectionEvaluator.java:131) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:128) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:197) [statistics] disconnected at org.talend.dq.analysis.AbstactSchemaAnalysisExecutor.runAnalysisLow(AbstactSchemaAnalysisExecutor.java:65) at org.talend.dq.analysis.ConnectionAnalysisExecutor.evaluate(ConnectionAnalysisExecutor.java:57) at org.talend.dq.analysis.AnalysisExecutor.runAnalysis(AnalysisExecutor.java:280) at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:133) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:157) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:141) at org.talend.dq.analysis.ReportExecutor.execute(ReportExecutor.java:62) at org.talend.dataquality.reporting.engine.ReportDocGenerator.runReport(ReportDocGenerator.java:370) at org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:204) at test_link.tdqreportrun_1370595579170_0_1.tdqReportRun_1370595579170.tDqReportRun_1Process(tdqReportRun_1370595579170.java:756) at test_link.tdqreportrun_1370595579170_0_1.tdqReportRun_1370595579170.runJobInTOS(tdqReportRun_1370595579170.java:1092) at test_link.tdqreportrun_1370595579170_0_1.tdqReportRun_1370595579170.main(tdqReportRun_1370595579170.java:958) Caused by: java.lang.NullPointerException at org.talend.commons.utils.workbench.extensions.ExtensionImplementationProvider.createInstances(ExtensionImplementationProvider.java:161) at org.talend.commons.utils.workbench.extensions.ExtensionImplementationProvider.getInstanceV2(ExtensionImplementationProvider.java:128) at org.talend.commons.utils.workbench.extensions.ExtensionImplementationProvider.getInstanceV2(ExtensionImplementationProvider.java:105) at org.talend.core.model.metadata.builder.database.ExtractMetaDataFromDataBase.<clinit>(ExtractMetaDataFromDataBase.java:137) ... 22 more {code}5
772TDQ-7471"Export report script" should now export a generated jobThe action of this menu must be replaced by: - the generation of the job with the tDqReportRun component - the export of the job (as it would be done it in DI perspective) 8
773TDQ-7479Remove second page of parser rule creation wizardThis page is useless. Remove it. 3
774TDQ-7504Match Analysis Editorh3. New analysis Create a new kind of analysis called "match analysis" under the "column set category". h4. User stories *As a* data quality user, *I want* to easily create a profile analysis *so that* I can find duplicate records (just like the tMatchGroup component does). *TODO* write other User stories + acceptance criteria The analysis setting tab is described by the "Match Editor" mockup. h4. Select Data Set the "Create connection" button opens a connection wizard (the first page is the metadata page usually used in wizard, the second page asks the user to choose between a database and a file, the following pages are related to the previous choice). At the end of the creation wizard, the user is asked to select the data (as it would be done in the "select data" wizard described just below). The "Select Data" button opens the columns selection window. When the user clicks ok, a sample of the data is retrieved and displayed in the data table. Notice that the data table has *6* additional columns (all columns related to the matching: GID, GRP_SIZE... and the BLOCK_KEY column) which are empty at the beginning. (Attribute scores is the MATCHING_DISTANCES of the component actually). h4. Adding blocking keys The "Select blocking key" button is a push button. When the button is pushed, the user will be able to add rows into the "blocking key" table by selecting the columns in the "data" table. When the user clicks once on a column in the data table, this column is added to the blocking key table. The selected column header becomes red color. When the user clicks again on the same column in the data table, this column is removed from the blocking key table and the color of the header in the data table is the default. When the user clicks on the button again, then the selection ends. h4. Adding match keys The "Select matching key" button is a push button. When the button is pushed, the user will be able to add rows into the "matching key" table by selecting the columns in the "data" table. When the user clicks once on a column in the data table, this column is added to the matching key table (in all match rules tabs when there several match rule tabs - the first one when no match rule exist yet). The selected column header becomes green color. When the user clicks again on the same column in the data table, this column is removed from all the matching rules in the match key table and the color of the header in the data table is set back to the default color. When the user clicks on the button again, then the selection ends. h4. Removing blocking keys A right-click on a row in the blocking key table will display a "Remove element" menu. This menu will remove the selected key(S) from the blocking table. The "DEL" key from the keyboard must also be enabled to remove columns. h4. Removing matching keys A right-click on a row in the matching key table will display a "Remove element" menu. This menu will remove the selected key(S) from the match rule of the match key table. The "DEL" key from the keyboard must also be enabled to remove columns. h4. Execution prerequisites Selecting a blocking key is optional. The user may not select any blocking key but at least one match key is required. A pop-up should display when the user tries to save or run the analysis without any match key defined. h3. Running charts h4. block chart The "Visualize" button will refresh the charts according to the settings and the data sample. It will also compute the generated key and update it in the data table. h4. match chart The "Visualize" button will refresh the charts according to the settings and the data sample. It will compute the groups and update the corresponding fields in the data table. The chart must be interactive as the one in the tMatchgroup component configuration wizard. h2. Result tab The analysis run button will execute the matching rules against the whole dataset and switch to the result tab. h3. Import, exporting match definitions. The import/export buttons will import and existing match definition from the repository or create a new match rule definition in the repository. The import button overwrite the local match rule. The export button creates a new match rule (hence a wizard as usual to create an item). This wizard is the same as the one for the "new match rule" (if we do it. Maybe, that's not needed). 13
775TDQ-7510when click "Move up" or "Move down" in column analysis editor, the tree of "Analyzed Columns" will be expanded all1. open a column analysis which have some columns, all some indicators for these columns 2. collapse all 3. select one column, click "Move up" or "Move down" 4. the tree will be expanded all, actually we expect the tree be collapsed all still5
776TDQ-7539Implement the import/export to repository actionsNULL20
777TDQ-7595Port the tGenKey component to the M/R frameworkNULL13
778TDQ-7596Port the tMatchGroup component to the M/R frameworkThis component will reuse API from the tMatchGroupHadoop component. 13
779TDQ-7597Deprecate the tLaunchDqReport- Remove it from the palette (just hide it or directly delete it?) 3
780TDQ-7611Create version 5.2.3 in Babili and populate itNULL2
781TDQ-7614Export babili translations into 5.2 branch of GITNULL2
782TDQ-7625 Configuration wizard of tMatchGroup does not work if it is used after tRecordMatchingcf attached job13
783TDQ-7635Unify component properties layout for DQ hadoop component1. the DQ components tGenKeyHadoop and tMatchGroupHadoop have two fields : host and port whereas tHDFSInput has only one field: NameNode URI. Merge these two fields into a single field. And create the migration task supporting old component configurations. 2. Add the HDFS browser button for the HDFS Directory field. 3. Enable the use of hadoop cluster configuration (Property type: built-in or repository selector in tHDFSInput for instance) by adding the property type combo to these two components. 13
784TDQ-7676Get the correct bundle name with different database typeIn function DynamicInputNodeHelper.addInputNode(),still use the deprecated function 'addComponent(String exactName, String id, Point location)'. At here,should get the correct bundle name with different database type(Mysql,HIVE...),then replace 'addComponent(String exactName, String id, Point location)' with 'addComponent(String bundleName, String exactName, String id, Point location)'.5
785TDQ-7692Match Analysis ReportingEnable Match analysis to be included in the reports. 3
786TDQ-7702Cancel the analysis execution but the "Run" button is still disabledwhile running an analysis, the "Run" button is disabled but if I cancel the execution the button still disabled need reopen the analysis editor expected result: while I cancel the process the button should be enabled actually result: the button is disabled1
787TDQ-7703tDqReportRun job should give correct information when datamart structure does not existfor hsqldb, the datamart structure is created automatically, and the job works well. but for mysql and oracle datamart, the structure must be created by user. Otherwise, the EXE_STATUS should be false and an error message should be shown in the result list. Currently, the EXE_STATUS is true and the message is empty.2
788TDQ-7737Create version 5.4.0M2 in Babili and populate itNULL2
789TDQ-7739Create version 5.3.2 in Babili and populate itNULL2
790TDQ-7780Refine the entrypoint of new match analysis creation- Move "Match Analysis" from "Column Analysis" to "Table Analysis" - Add context menu on repository view on table and column node. - Add the new analysis into cheat sheets. (extracted to a separate task TDQ-8230)13
791TDQ-7827hive connection not show in "Connections" viewNULL5
792TDQ-7831Add move up/move down button for match key and blocking key table in rule definition editorfinished up and down button Operating on the UI. 8
793TDQ-7840set the "Link with Editor" default value is "linked"when the first time start a studio, set this3
794TDQ-7842Investigate why when start studio the first, the layout of perspective is differentsee https://jira.talendforge.org/browse/TDQ-7829 the size is a little smaller than on tdq(see attachment files) it is strange even they use the same configuration file 5
795TDQ-7845Export babili translations into trunk of SVNNULL2
796TDQ-7847Export babili translations into trunk of SVNNULL2
797TDQ-7849Create version 5.4.0M3 in Babili and populate itNULL2
798TDQ-7869Buttons improvements in Match AnalysisSee attached screen capture.3
799TDQ-7877Technical improvements for match analysisNULL13
800TDQ-7882Complete Contextual Datamart Feature - Enable to propage a context to a list of reportsNULL13
801TDQ-7892issue for vertica after feature TDQ-2104issue 1. benford law indicator can not drill down, both int type and varchar type column for int type column: operator does not exist: int ~~ unkonw. for varchar type column: invalid item drill down, syntax error at or near "Regexp' issue 2. for the generate job function on result page, all can not work work. issue 3. analysis set sql engine, generate report, frequency indicator will show all the items, limit 10 seems doesn't work. issue 4. when crate dbconnection, doesn't set database, so it will set 'default' in Repository, overview analysis can not run with oracle datamart. errors for issues refer to file attached.13
802TDQ-7894Improve Create Connection wizardThe current layout of the "create connection" wizard of the match analysis editor must be improved. See attached screen capture. 3
803TDQ-7903Create a help page for the new Match Analysis wizardNULL3
804TDQ-7910Import match rules from repository into matching componentsBe able to import existing match rules from the repository into the tMatchGroup, tRecordMatching, tGenkey (std and M/R), tMatchGroupHadoop components. 13
805TDQ-7917Disable the ability to add the match analysis into a report. We can't generate a report from this kind of analysis. Therefore, we must remove the right-click menu "new Report" on this kind of analysis. And in the report editor, we must not be able to select this type of analysis.3
806TDQ-7918Check whether we can profile the exist Hive distributionsNULL20
807TDQ-7919Create version 5.4.0RC1 in Babili and populate itNULL2
808TDQ-7944Restore the tLaunchDQReport component and put it in the technical categoryThe component must not be removed from the palette until the 6.0 version. Therefore, we must restore it and hide it from the usual palette by adding it to the technical category and removing it from the DQ category. 5
809TDQ-7951Add the context selection button in the context view when it's attached to a reportwhen the preference page is not contextualized and I create a new report, I cannot add an existing context to the report. I need to be able to add a context to a report, just as we add context to jobs. Enable the button in the context view that browse the contexts and can select them. 8
810TDQ-7975Create TUJ for standardization componentsConvert existing jobs to TUJs8
811TDQ-8020Design a library to sample data for analysesUse a Reservoir Sampling algorithm. See http://getpocket.com/a/queue/list/sampling/2
812TDQ-8027Make it possible for users to load the customized algorithm jar in match analysis editor.NULL13
813TDQ-8036Generated reporting job cannot runCreate a report, generate a "launch report job". Try to run it. It will ask for downloads of mysql and oracle drivers. After the drivers are downloaded, try to run the job. It still complains about missing jta.jar Try to run it nevertheless, then we get this exception: Starting job tdqReportRun_1379494104625 at 10:49 18/09/2013. [statistics] connecting to socket on port 4031 [statistics] connected Exception in thread "main" java.lang.NoClassDefFoundError: net/sourceforge/sqlexplorer/ExplorerException org.talend.cwm.db.connection.ConnectionUtils.findDriverByLibManageSystem(ConnectionUtils.java:581) org.talend.cwm.db.connection.ConnectionUtils.getClassDriver(ConnectionUtils.java:559) org.talend.cwm.db.connection.ConnectionUtils.createConnection(ConnectionUtils.java:176) org.talend.cwm.db.connection.ConnectionUtils.checkConnection(ConnectionUtils.java:227) org.talend.cwm.db.connection.ConnectionUtils.isConnectionAvailable(ConnectionUtils.java:369) org.talend.dataquality.reporting.engine.ReportDocGenerator.validateReport(ReportDocGenerator.java:339) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:215) test.tdqreportrun_1379494104625_0_1.tdqReportRun_1379494104625.tDqReportRun_1Process(tdqReportRun_1379494104625.java:779) test.tdqreportrun_1379494104625_0_1.tdqReportRun_1379494104625.runJobInTOS(tdqReportRun_1379494104625.java:1117) [statistics] disconnected test.tdqreportrun_1379494104625_0_1.tdqReportRun_1379494104625.main(tdqReportRun_1379494104625.java:982) Caused by: java.lang.ClassNotFoundException: net.sourceforge.sqlexplorer.ExplorerException java.net.URLClassLoader$1.run(URLClassLoader.java:366) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) java.lang.ClassLoader.loadClass(ClassLoader.java:423) sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 10 more Job tdqReportRun_1379494104625 ended at 10:49 18/09/2013. [exit code=1]8
814TDQ-8040Add a button "show in repository view" in the match analysis editorNULL5
815TDQ-8043Add a scroll bar in the data table when there is more data that can be seenCurrently, there is no scroll bar although we can scroll with the mouse wheel. There should be a scroll bar5
816TDQ-8044Add the ability to sort data by a click on the table header in the match analysisA click on the header should sort the data. 13
817TDQ-8045Allow the user to edit the match rule tab header.See screen capture.13
818TDQ-8063Support hive profiling for distribution HDP 1.3NULL8
819TDQ-8067DQ profiling support for HDP 2.0 in 5.4NULL5
820TDQ-8068Support hive profiling for MapR 3.0NULL5
821TDQ-8079Export babili translations into trunk of SVNNULL2
822TDQ-8082Create org.talend.dataquality.record.linkage.ui.nlThe internationalization fragment is missing for org.talend.dataquality.record.linkage.ui Create the i18n fragment of org.talend.dataprofiler.common.ui too. 2
823TDQ-8084Match rule editor changes for MDM / T-Swooshh4.General * It is the only DQ item that must *not* switch to the the Profiler perspective when clicked on. It is extremely annoying in the context of MDM. * Also it must *not* recall the other associated views such as the details view. h4.Editor GUI See [^matchrulechanges.png]. From top to bottom: * Radio labels: change T-Swoosh to: "MDM T-Swoosh Algorithm". We need "MDM" in there. * MDM T-Swoosh should be the default when created from MDM *--> Separate TMDM work item: TMDM-6350* * Hide the Block key generation panel. This is for a future iteration of MDM's integrated matching, not in 5.4. * Match key panel ** Title: change to "Match and Survive" ** Remove/hide the '+' button on the right-hand side, only *one* match rule allowed in T-Swoosh in 5.4 ** Merge the last 2 cols of the survivorship table into the match rule table. We can only define the survivorship key onto the same column as the match keys in T-Swoosh 5.4. So since it's a 1-1 between match keys and survivorship keys, let's just use a single table for both. ** Change the 2nd threshold's label to "Confident match threshold". * Remove/hide the survivorship panel altogether. Survivorship keys are always in par with match keys. *IMPORTANT NOTE:* These change requests are pure GUI, there should be no impact on the underlying EMF.20
824TDQ-8090Allow the user to reorder the match rule tabsWhen several match rule tabs exists in the analysis editor or in the match rule editor, the user should be able to reorder them by drag&drop.8
825TDQ-8144"MDM connection" should not be listed in the create connection wizard when creating match analysis-delete "MDM connection" from the list of connections in the connection wizard when creating match analysis (see the first capture). -delete "MDM connection" from the list of connections when you click the "Select data" tab in the match analysis editor(see the second capture).5
826TDQ-8151Create version 5.4.0 in Babili and populate itNULL2
827TDQ-8189Repository view is not refreshed after a MySQL connection creation the first time- start a new studio. - create a mysql connection - after the connection creation wizard is finished, the download dialog opens and asks for downloading mysql driver. - click download. - after the driver is downloaded, there is nothing to unfold below the connection. I can't access the catalogs, tables, ... See attached capture. 8
828TDQ-8190Support hive profiling for Cloudera 4.3 and 4.4 (Yarn/Hadoop2)NULL13
829TDQ-8191Export babili translations into trunk of SVNNULL2
830TDQ-8232Support profiling mapR 2.1.2 NULL3
831TDQ-8203delete analysis by right click on sub node of report node is not synchronous with editor of report if editor is openingdelete analysis by right click on sub node of report node should update report editor with same time. 1.create a report by right click on the analysis node. 2.keep report editor is opening and expand the sub node of report node try to find analysis node. 3.right click on the analysis node and select delete analysis action. 4.pop up a choose dialog ask you whether want to delete the analysis forever and choose yes. expect: the report editor should be updated. The analysis which be deleted just now should not exist on the analysis list. result: the analysis will exist yet. 5
832TDQ-8206"Hide" action should also hide data in the data sample table in the match analysis editorWhen clicking on the "hide groups less than x items", the data in the data table should be filtered out accordingly. Just like in the component5
833TDQ-8212Do not open the DQ repository view when saving the editorwe can follow the following 4 steps to do the refactoring: 1. refactoring DQRepositoryNodes 2. action/editor/page/handler, recursiveFind() 3. command line 4. sub nodes under connection details: 1.1 profiling node analysis node report node 1.2 library node indicator node pattern node rule node source file node jrxml node exchange node: need not to refactoring the above Nodes need to refactor, remove the property ModelElement and refactor the related method {code} private Analysis analysis; public Analysis getAnalysis() { return this.analysis; } public void updateAnalysis(Analysis ana) { this.analysis = ana; } {code} remove the property analysis and the method updateAnalysis() refactor the method getAnalysis(), get the analysis from the Node {code} public Analysis getAnalysis() { return ((TDQAnalysisItem)this.getObject().getProperty().getItem()).getAnalysis(); } {code} other node just like this 1.3 folder node and connection node need not to refactoring 2.1 action OpenItemEditorAction : using RepositoryNode as the parameter of this class, refactoring the related codes to adapt to this change RunAnalysisAction: keep using the Item, add comments here, remove the deprecated method 2.2 editor/page/handler AbstractItemEditorInput : using RepositoryNode as the parameter, all the Editor and pages need to adapt to this change org.talend.dataprofiler.core.ui.wizard.analysis.AbstractAnalysisWizard.openEditor(Item item): get the Node from the Item first and then pass the Node to the EditorInput 2.5 recursiveFind() need to remvoe most recursiveFind() method, but still need to keep several recursiveFind() method, because some time still need to find the node according to the ModelElement or other type object these refactoring need to deal with as a whole, this part will cost more time than first part ReportWriter line 74: ... AnalysisRepNode recursiveFindAnalysis = RepositoryNodeHelper.recursiveFindAnalysis(ana); ... if (recursiveFindAnalysis != null && recursiveFindAnalysis.getProject().isMainProject()) { ... find another method to check the project is main project or reference project create the RepositoryNode first when use wizard to create Item, then use this node to open the editor for the 3 and 4 step, we can do them later 7
834TDQ-8214Match analysis editor cosmetic changesSee pic.2
835TDQ-8230Create cheat sheet for new Match Analysis.NULL5
836TDQ-8236Eclipse help view for the Match rule wizard.The Match rule creation wizard is accessible from the Repository. So contextual help should be availalble using the F1 key, and should also be available with a Help button at the bottom of the wizard (eclipse already provide this feature, it just needs to be activated).8
837TDQ-8242TOP should do same things as TDQ to open the dialog which can download all of jar files when stdio is opening TOP should do same things as TDQ to open the dialog which can download all of jar files when stdio is opening. The image of dialog has been attached. 13
838TDQ-8252Support hive profiling for MapR 2.1.3NULL5
839TDQ-8256Hadoop components for DQ support HDP 2.0.0The DI Hadoop components now support HDP 2.0.0. So the DQ Hadoop components might need to keep pace.8
840TDQ-8265update the content when check mysql database user privilegesNULL5
841TDQ-8282Update tmatch group "refresh" button labelUpdate tMatchGroup refresh button in the configuration wizard. Refresh name is not intuitive. Could be better with "Chart" or "Visualize" 2
842TDQ-8289If you change the basic data set for the matching analysis the whole screen should be resetNULL5
843TDQ-8325Reduce memory usage during TDQ item exportI have 44 analyses and 7 reports in my project and I clicked at the export wizard button. The wizard is open after 10 seconds of dependency calculation. and the memory usage is shown in the attached picture. 2
844TDQ-8350Create version 5.4.1 in Babili and populate itNULL2
845TDQ-8360After change the analyzed file connection path columns in analysis will be removed even the news are same as the originalsanalyze a file connection keep the analysis editor open, and if change the file path and retrieve the new schema(some columns are same as the originals) and do NOT update the editor for column analysis columns still in editor, but actually all columns are removed for match analysis columns in match analysis editor do not change(originals) click "select data" to open the column selection dialog, you can see only the same columns are checked This issue need to implement a new feature of reload file connection.13
846TDQ-8376Cannot edit a synonymOpen addons/data/synonym/idx_city_exonyms/all_4_countries Search "strasbourg" Edit the entry to remove "Est" as a synonym. Save. It yields to an error and nothing is saved. See pic3
847TDQ-8377Technical - Refine commit of TDQ-8068 Support hive profiling for MapR 3.0For commit : http://talendforge.org/trac/top/changeset/111240#file0 - Add a comment to explain the logic for if/else.1
848TDQ-8381Export babili translations into trunk of SVNNULL2
849TDQ-8385handle org.talend.dqdemosNULL3
850TDQ-8394when create datamart with user which doesn't have enough privileges, can get only one error.1. create a report 2. set datamart information in report editor(mysql/oracle), make sure (1)user just have access privileges. (2) datamart tables/views doesn't exist. 3. then click "check", try to create datamart. Expected Result: get many error for what privileges we need to add Actual Result: just get an error , refer to doc attached.5
851TDQ-8395tRecordMatching : bug with lookupThere is a bug with the tRecordMatching and it's lookup. In the "End" part of the code, the lookup is flushed and it's caused big issue when you use the component : - after an iterate link - in a Data Service (ESB) Workaround : edit the code surrounded in the screenshot5
852TDQ-8401Hive profiling cannot finish on mapR3.0 embedded mode in Win 8From TDQ-8068 tested on build Talend-Studio-r111555-V5.4.1EP while run analysis with embeded mode with hive in MapR 3.0.1 the process is always running and will never stop no error log8
853TDQ-8428Sampling algorithm to run Analysis on a sample of data which is not necessary the first 1000 or first 5000 rows.It would be nice to have some smart Sampling algorithm which can return a smaller dataset than the entire dataset while we are doing our PROFILE analysis and Matchgroup set up. The idea is to have a significant sample, random and not only filter on the x first rows of our data sets. 8
854TDQ-8429in demo project the first analysis--GenderAna can not genereate ETL job correctly about the pattern(Email Address)1. create a new project. 2. on the welcome page,click "Demos", on the pop up dialog select dq demo, and import it. 3. change the msyql configuration to your correct one. 4. run the fist analysis--enderAna. 5. focus on "Result page", right click on the pattern --> Email Address -->Generate Job, on the pop up dialog select the first one option. Expected Result: generate a job correctly. Actual Result: job can generated but the dialog still show. note: just create a new connection, and column analysis with pattern, the issue won't show. {code} java.lang.NullPointerException org.talend.designer.core.ui.editor.nodes.Node.checkSchema(Node.java:3410) org.talend.designer.core.ui.editor.nodes.Node.checkNode(Node.java:3685) org.talend.designer.core.ui.editor.nodes.Node.checkAndRefreshNode(Node.java:3676) org.talend.designer.core.ui.editor.cmd.QueryGuessCommand.execute(QueryGuessCommand.java:165) org.talend.datacleansing.core.ui.actions.IndicatorJobAction.setParameters(IndicatorJobAction.java:144) org.talend.datacleansing.core.ui.actions.pattern.PatternIndicatorJobAction.setParameters(PatternIndicatorJobAction.java:93) org.talend.datacleansing.core.ui.actions.pattern.PatternValidRowsJobAction.setParameters(PatternValidRowsJobAction.java:50) org.talend.datacleansing.core.ui.jobs.template.AJobAction.addTemplateNodes(AJobAction.java:295) org.talend.datacleansing.core.ui.jobs.template.AJobAction.doRun(AJobAction.java:153) org.talend.repository.ui.actions.AContextualAction$2.run(AContextualAction.java:611) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:237) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3197) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1979) org.talend.repository.ui.actions.AContextualAction.run(AContextualAction.java:617) org.talend.datacleansing.core.ui.actions.IndicatorJobAction.run(IndicatorJobAction.java:327) org.talend.datacleansing.core.ui.actions.ui.pattern.PatternJobSelectWizard.performFinish(PatternJobSelectWizard.java:66) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.datacleansing.core.ui.service.DatabaseJobService.createJobActon(DatabaseJobService.java:97) org.talend.datacleansing.core.ui.service.DatabaseJobService.executeJob(DatabaseJobService.java:77) org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory$1.widgetSelected(ChartTableFactory.java:152) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:145) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) {code}8
855TDQ-8431tRecordMatching import rules from dq Repository, some parameters can not set correctly.1. create rule manually or export from match analysis, --make sure rules have a key item select "Matching Function" select "Custom" and set class name. 2. create a job add tRecordMatching 3. on the Component tab of tRecordMatching, click "import rules from Repository" 4. on the pop up dialog select the rules. Expected Result: parameters set correctly, job can run well. Actual Result: "Matching Function" set "Exact", "Custom Matcher" lose "double quote", and add jar name, in fact, have jar name job can not run.5
856TDQ-8433Component that generates duplicatesCreate a component that generates duplicate data from an input flow. This component would be mostly used in combination with a tRowGenerator. Settings: - percentage of duplicates to generate (will tell how many rows to generate from a given row - will be less than one). This means that when a row comes in, we must decide whether to generate or not a duplicate row (In order to do this, we could use a sampling algo). - fields that are subject to changes (choose which columns may have changes) - for each chosen field, choose how to modify them. - this could be exact duplicated value - approximate duplicated value - replacement value (use a synonym from an index file) - delete value (set to null or blank) - min and max percentage of fields to be modified 8
857TDQ-8443Drag a UDI to current folder will throw 2 errorin DQ Repository, drag a UDI to current folder will get 2 error {code} Problems occurred when invoking code from plug-in: "org.eclipse.ui.navigator". -------------------------------------------------------------------------------------------------------------------------------------- org.eclipse.core.runtime.AssertionFailedException: assertion failed: Cannot move '/TOP_DEFAULT_PRJ/TDQ_Libraries/Indicators/User Defined Indicators/Copy_of_Row_Count_0.1.properties'. Destination should not be under source's hierarchy. org.eclipse.core.runtime.Assert.isTrue(Assert.java:110) org.eclipse.core.internal.resources.Resource.assertMoveRequirements(Resource.java:195) org.eclipse.core.internal.resources.Resource.move(Resource.java:1585) org.eclipse.core.internal.resources.Resource.move(Resource.java:1565) org.talend.commons.utils.workbench.resources.ResourceUtils.moveResource(Unknown Source) org.talend.core.repository.utils.XmiResourceManager.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveObject(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2$1.run(Unknown Source) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1957) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2.run(Unknown Source) org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveOthersNode(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveRepositoryNodes(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.handleDrop(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(Unknown Source) org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) org.eclipse.swt.dnd.DropTarget.Drop_64(DropTarget.java:392) org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:260) org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code} {code} assertion failed: Cannot move '/TOP_DEFAULT_PRJ/TDQ_Libraries/Indicators/User Defined Indicators/Copy_of_Row_Count_0.1.properties'. Destination should not be under source's hierarchy. -------------------------------------------------------------------------------------------------------------------------------------- org.eclipse.core.runtime.AssertionFailedException: assertion failed: Cannot move '/TOP_DEFAULT_PRJ/TDQ_Libraries/Indicators/User Defined Indicators/Copy_of_Row_Count_0.1.properties'. Destination should not be under source's hierarchy. org.eclipse.core.runtime.Assert.isTrue(Assert.java:110) org.eclipse.core.internal.resources.Resource.assertMoveRequirements(Resource.java:195) org.eclipse.core.internal.resources.Resource.move(Resource.java:1585) org.eclipse.core.internal.resources.Resource.move(Resource.java:1565) org.talend.commons.utils.workbench.resources.ResourceUtils.moveResource(Unknown Source) org.talend.core.repository.utils.XmiResourceManager.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveObject(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2$1.run(Unknown Source) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1957) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2.run(Unknown Source) org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveOthersNode(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveRepositoryNodes(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.handleDrop(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(Unknown Source) org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) org.eclipse.swt.dnd.DropTarget.Drop_64(DropTarget.java:392) org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:260) org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}5
858TDQ-8451Job about tGenkey and tGenkeyHadoop can not run well when select "remove[diacritical marks and lower/upper case]" for pre-algorithm1. create a job with input+tGenkey/tGenkeyHadoop+output 2. add one column for tGenkey/tGenkeyHadoop at Algorithm part. 3. set pre-algorithm with "remove diacritical marks and upper/lower case" or "remove diacritical marks " 4. run job. Expected Result: job can run well. Actual Result: job run failed. note: ok on 5.3.1, no 5.3.2 build now so doesn't test, {code} Exception in thread "main" java.lang.NoClassDefFoundError: org/talend/utils/string/AsciiUtils org.talend.windowkey.AlgoBox.removeDiacriticalMarks(AlgoBox.java:325) org.talend.windowkey.AlgoBox.removeDMAndUpperCase(AlgoBox.java:367) test2a.job_tgenkey_0_1.job_tGenkey.tOracleInput_1Process(job_tGenkey.java:1098) test2a.job_tgenkey_0_1.job_tGenkey.runJobInTOS(job_tGenkey.java:1501) test2a.job_tgenkey_0_1.job_tGenkey.main(job_tGenkey.java:1366) Caused by: java.lang.ClassNotFoundException: org.talend.utils.string.AsciiUtils java.net.URLClassLoader$1.run(URLClassLoader.java:366) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) java.lang.ClassLoader.loadClass(ClassLoader.java:424) sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 5 more {code}3
859TDQ-8460when set an unexist folder for the tDqReportRun, can't generate report doc file but show success in the logcreate a tDqReportRun job, set an unexist folder for it, run this job Except Result: can't generate report doc file, show failed in the log Actual Result: can't generate report doc file, but show success in the log8
860TDQ-8470on the "cheat sheet selection dialog" (get by Help-->cheat sheets...)doesn't contains match anaysis under "Talend->Analysis" 1. click Help-->cheat sheets... 2. check the pop up dialog, under "Talend-Cheat sheets"-->analysis, Actual Result no match analysis here Expected Result: on the cheat sheet tab list have match analysis, may be we should also show here.5
861TDQ-8481Cannot select table from a file connection in the match analysis wizard# create a file connection # Open the match analysis wizard with the "new analysis" menu and click "next" # select the "metadata" table in the file connection and click "finish" This gives the following exception and no data appear in the analysis editor. java.lang.ClassCastException: org.talend.core.repository.model.repositoryObject.MetadataTableRepositoryObject cannot be cast to org.talend.core.model.metadata.MetadataColumnRepositoryObject at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.translateNodeIntoModelElement(MatchMasterDetailsPage.java:1083) at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.translateSelectedNodeIntoModelElement(MatchMasterDetailsPage.java:1063) at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.refreshColumnAndData(MatchMasterDetailsPage.java:842) at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.setSelectedNodes(MatchMasterDetailsPage.java:838) at org.talend.dataprofiler.core.ui.wizard.analysis.column.MatchWizard.updateAnalysisBySelectedNode(MatchWizard.java:92) at org.talend.dataprofiler.core.ui.wizard.analysis.column.MatchWizard.openEditor(MatchWizard.java:79) at org.talend.dataprofiler.core.ui.wizard.AbstractWizard.performFinish(AbstractWizard.java:67) at org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) at org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) at org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.jface.window.Window.runEventLoop(Window.java:825) at org.eclipse.jface.window.Window.open(Window.java:801) at org.talend.dataprofiler.core.ui.action.actions.CreateNewAnalysisAction.run(CreateNewAnalysisAction.java:112) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:145) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) 3
862TDQ-8482incomplete matching distances in match analysis editorSee attached screen capture5
863TDQ-8497improve the dialog messagewhen do empty recyle bin1
The file is too large to be shown. View Raw