7.2.x Release Notes

Owned by Andreas Küster
Last updated: Jul 22, 2019
35 min read

Datameer's release notes provide information and resolutions on improvements, bug fixes, and visual changes for 7.1.x maintenance release versions.  

Visit Datameer's Help Center for additional information or contact your customer service representative. 

7.2.12 Release Notes

Bug Fixes

1

External authentication: Active Directory / LDAP - can not add new User or Groups
DAP-38734

It is possible to administrate user and group settings again.

(tick) Bug fixed.

2

Display meaningful Error Message for rename Column with more than 255 chars
DAP-38732

The user will now receive a meaningful error message.

(tick) Bug fixed.

3

Not Possible to Delete an Upload Job if the Uploaded File has Spaces in the Name
DAP-38600

Spaces in an upload job's file name will no longer prevent them from being deleted.


(tick) Bug fixed.

4

hadoop.usernameForSalt Property Can not be Enabled
DAP-38598

It is now possible to control the hadoop.usernameForSalt property.

(tick) Bug fixed.

5

Workbook: "Go to line" functionality won't jump to the desired line in the Workbook

DAP-38518


"Go to line" jumps to the correct line in a workbook sheet.

(tick) Bug fixed.

7.2.11 Release Notes

Improvements

1

Add Support for Apache 2.7.7DAP-38590

Support added for Apache 2.7.7

2

Add Support for CDH 6.1.1DAP-38675

Support added for CDH 6.1.1

3

Add Support for CDH 6.2.0DAP-38674

Support added for CDH 6.2.0

Bug Fixes

1

Export Job Failure Using sFTP Connection
DAP-38479

Export jobs using the sFTP connection now work as expected.

(tick) Bug fixed.

2

Slow to generate a Large Table from a HiveServer2 Connection
DAP-38526

When creating a data link to a table in a database with a high count of tables, the performance time to list the tables has been greatly improved.

(tick) Bug fixed.

3

The Capabilities for an Analyst User to Access the Admin Area Aren't Handled Properly
DAP-38610

  • If a user has the READ but not EDIT capability for any section, the admin buttons are disabled.
  • Non admin roles can no longer open user/role editing without the EDIT capability.
  • If a user has create/edit/delete capabilities, the corresponding sections are visible and the user can work with them.
  • The Job Scheduler and Event Bus sections work for users that have Admin capabilities.
  • The variables section is visible for users if the READ capability is set.
  • The admin tab can be opened by any user with at least one capability in the admin area.

(tick) Bug fixed.

4

When Datameer Is Deployed on an EMR Cluster Which Uses S3 as Job Storage, It Isn't Possible to Use Visual Explorer 
DAP-38621

Visual Explorer is again available when Datameer is deployed on an EMR cluster using S3 as job storage.

(tick) Bug fixed.

7.2.10 Release Notes

Improvements

1

Add Support for CDH 6.1.0DAP-38147

Support added for CDH 6.1.0

Bug Fixes

1

Duplicating a Sheet Doesn't Copy the Sheet Description
DAP-38020

When a workbook sheet is duplicated, the description is now copied.

(tick) Bug fixed.

2

A Null Pointer Exception Occurs When Trying to Configure a Secured MapR Cluster
DAP-38423

Configuring a secured MapR cluster is again possible.

(tick) Bug fixed.

3

Configuring the Auto-Reduce Parallelism for the Tez Execution Engine Doesn't Take the Configured Job Queue into Account for the Max Number of Reduce Tasks
DAP-38473

  • The configured das.job.queue property now scales the max number of reducers for each Tez job.
  • The configured das.job.queue property is now used when generating input splits.
  • If the YARN queue can't return a percentage, the das.job.cluster-resource-percent property is defined if not set to auto.
  • If none of the above, the whole cluster's vcore availability is used.

(tick) Bug fixed.

4

A Duplicated Sheet Is No Longer Kept per Default
DAP-38531

Duplicated worksheets are now kept per default when a workbook is saved.

(tick) Bug fixed.

5

Using Reserved Words in a Hive Partitioned Column Fails
DAP-38552

It is now possible to use Reserved Keywords for Hive partitioned columns.

(tick) Bug fixed.

7.2.9 Release Notes

Improvements

1

Change EMR Cluster SettingsDAP-38357

Users can now choose between EMR Cluster ID, EMR Cluster Name, or YARN Resource Manager to decide which is the host cluster.


Bug Fixes

1

Workbooks Failing with Unkept SQL Sheets
DAP-38431

Workbooks now no longer fail even if running when some sheets in the workbook aren't marked as kept.

(tick) Bug fixed.

2

Infographic Legend Vulnerabilities
DAP-38427

Scripts are no longer runnable if crafted in the prefix/suffix for an infographic widget.


(tick) Bug fixed.

3

Adding a Spark Execution to the Job Graph Causes an Error
DAP-38409

Spark jobs now run successfully when added to the Job Graph.


(tick) Bug fixed.

4

HdfsPermissionSynchronizer Doesn't Respect auth_to_local Rules
DAP-38399

secure_hdfs_tool.sh now translates usernames so that the Datameer conductor reads them correctly. It now sets permissions according to hadoop.security.auth_to_local rules introduced on the Datameer Admin tab.


(tick) Bug fixed.

5

Problem Using the RTA Plug-in 5.1 from 7.5.0 Utilizing the Yarn Backend
DAP-38380

Users can now utilize visual exploration when using Yarn as a backend for the RTA plug-in.


(tick) Bug fixed.

6

The Direct Task Executor Doesn't Close the Entity Manager in an Error Case
DAP-38373

The direct task executor now closes the entity manager in case of an error during task executions.


(tick) Bug fixed.

7

Housekeeping Tries to Purge Export Job Data Files from HDFS Which Don't Exist
DAP-38324

This was an issue due to status logging in Housekeeping. Upon starting Datameer, the non-existent jobs that were set to be deleted are reset.


(tick) Bug fixed.

8

The Browse All Data Page Doesn't Show Data Sometimes
DAP-38314

If you Browse All Data and no sheets are kept in the workbook an error message is now displayed explaining the issue.


(tick) Bug fixed.

9

Workbooks are Failing with an Error - Parquet Is Not a Parquet File (Too Small)
DAP-38224

The DatameerFileWriter opening an output file for write in a task now fails that task immediately to prevent creating a corrupted file.

  • Error logs are no longer written with VerifyExceptions for every record stating the writer has already been closed.
  • These tasks now fail with an UnrecoverableException.

(tick) Bug fixed.

10

The CAST Function is Returning Errors
DAP-38081

The SQL worksheet function CAST has now been documented so users can understand what to expect.


(tick) Bug fixed.

11

Problems Exporting to Partitioned Hive Tables in Parquet Format
DAP-37015

All partitions are now readable after an export to Hive has completed successfully.


(tick) Bug fixed.

12

The Preview Record View Changes While Moving a Column
DAP-33298

The preview record view is now kept and doesn't change while moving a column.


(tick) Bug fixed.

7.2.8 Release Notes

Improvements

1

Add Support for OpenJDK 8DAP-38162

Support added for OpenJDK 8.


2

Add Support for CDH 5.15.2DAP-38270

Support added for CDH 5.15.2


3

Add Support for MapR 6.1 (Along with MEP 6.0)DAP-38148

Support added for MapR 6.1 and MEP 6.0.

4

Simple Theta-joins Are Now Supported Where Equi-joins and Filters Are Possible on SQL SheetsDAP-37703

  • Datameer supports inner, left outer, and right outer joins with multiple criteria.
  • When running full outer joins, an error message is now displayed stating that it isn't supported.

Bug Fixes

1

Command "Conductor.sh start|stop|check" Shouldn't Report False Results
DAP-32789

The command now checks if a process with the assumed PID of the Datameer embedded Jetty web service still exists and report the correct results.

(tick) Bug fixed.

2

Stabilize Date-Time Functions for SQL Worksheets
DAP-37854

The following functions have been updated:

  • CEILINGDATE
  • FLOORDATE
  • TIMESTAMPDIFF
  • DAYOFYEAR
  • QUARTER
  • WEEKOFYEAR

(tick) Bug fixed.

3

Publicly Shared Infographic Doesn't Show Data
DAP-37945

Publicly shared infographics now show the correct data.


(tick) Bug fixed.

4

A Workbook Was Stuck Processing an SQL Sheet
DAP-38015

Long processing time due to cross-products when the join attribute differs between worksheets.

Workaround:

  • If a job is sticking, use Datameer traditional instruments to re-create the logic that the MySQL query is supposed to introduce.

The job logs now show when joins will be a cross-product so services can quickly diagnose the problem for users.


(tick) Workaround.

5

The Cell Context Menu in Workbooks Should Only Include Input and Nothing Else
DAP-38033

A cell's context menu now only displays the current cell input.


(tick) Bug fixed.

6

Save&Run Fails for Workbooks Without a Source Sheet
DAP-38105

The Save&Run option now works as expected. When selected, the workbook is saved and then the job is set to immediately run.


(tick) Bug fixed.

7

Worksheet Error after Applying SQL Query with "Sub"
DAP-38131

The query option now works without error.


(tick) Bug fixed.

8

It Isn't Possible to Resize the Multiline Editor after Zoom In/Out
DAP-38172

It is now possible to resize the multiline editor.


(tick) Bug fixed.

9

Attempting to Set tez.task.launch.cmd-opts to Prevent the Container Running Beyond Memory Limits Always Fails
DAP-38225

Setting the tez.task.launch.cmd-opts property correctly now prevents the possibility of a container running beyond its limits.


(tick) Bug fixed.

10

Workbooks Using a Hive Data Link with the Small Job Framework Isn't Working in a Kerberos Secured Environment
DAP-38226

Now when using a Kerberos secured cluster, a workbook using a Hive data link in Small Job works correctly.


(tick) Bug fixed.

11

Users Are Unknown to the User Authentication Service after Upgrading Datameer
DAP-38275

Users from authentication services are now recognized correctly after upgrading.


(tick) Bug fixed.

12

TIMESTAMPDIFF Function Returns Negative Value for Milliseconds Interval
DAP-38283

TIMESTAMPDIFF now returns the properly signed value for "MILLISECOND" intervals.


(tick) Bug fixed.

13

Backing Up of Only Specific Files Includes Unwanted Folder Definitions
DAP-38296

Only the specified files are now included in the zip when backing up specific files from a folder.


(tick) Bug fixed.

14

An Implicit Join on Certain Data Types Result in a Cross Join
DAP-38310

Implicit joins with a "=" join condition on string keys no longer result in a cross product being calculated.


(tick) Bug fixed.

15

Concurrent Editing Warning of the Current Logged in User When Saving a New Workbook
DAP-38302

The concurrent edit warning is now correctly only displayed if two or more different people have accessed the workbook.

(tick) Bug fixed.

16

External Sheet Schema Update Throws Exceptions When a Column Was Renamed and Another Was Deleted
DAP-38333

Workbooks can now be opened correctly without error.

(tick) Bug fixed.

17

Max Log Errors Aren't Mandatory but Expected as Such in Immutable Generation
DAP-34795

The "Max number of errors" field can no longer be left blank.

(tick) Bug fixed.

18

Single Group Sharing for Secure Impersonation Isn't Being Handled Properly in the Ui
DAP-37904

  • An error message is displayed in UI if multi group sharing isn't allowed.
  • An error message is displayed in UI, if the CSRF token is invalid.

(tick) Bug fixed.

19

The Workbook Shortcut cmd+c Doesn't Work in the Formula Editor When Using the Firefox Browser
DAP-38320

This shotcut (cmd+c) for copying data now works in the formula editor when using Firefox.

(tick) Bug fixed.

20

Custom Properties Missing from job-definition.Json If User Is Restricted from Settings
DAP-37697

The job-definition.json file is now properly storing the custom properties when created.

(tick) Bug fixed.

7.2.7 Release Notes

Improvements

1

Add Support for Cloudera CDH 5.16.1DAP-38171

Support for Cloudera CDH 5.16.1 has been added.


Bug Fixes

1

Auto Detect BIG_INTEGER While Ingesting Data
DAP-35071

BIG_INTEGER values from CSV and XLS are now correctly imported.


(tick) Bug fixed.

2

The Inspector Breaks after Exchanging a Datasource with Upstream Dependencies Based on RTA Sheets
DAP-37255

Exchange datasource functionality no longer causes an error in the workbook inspector.


(tick) Bug fixed.

3

Users Can't Access All Menu Options When the Dependency Graph Is Open
DAP-37341

Now, when interacting with the menu or the + button, the dependency graph closes as expected and all menu options are functional.


(tick) Bug fixed.

4

The Inspector Breaks When Users Delete a Referenced Column From an RTA Sheet
DAP-37555

It is no longer possible to delete referenced columns from an RTA sheet.


(tick) Bug fixed.

5

Workbook Error: "Unable to Execute 'Merge error log %s' java.io.EOFException: Unexpected end of input stream"
DAP-37889

A workbook error was being delivered when small processing errors were not being added to added to the error.log. The filter has been readjusted so this extraneous error message is no longer thrown under these conditions.


(tick) Bug fixed.

6

The Handle for Making the Multiline Editor Taller Is Too Small
DAP-37969

The handle height has been increased to make the size adjustment tool more convenient.


(tick) UI updated.

7

Javascript Error In mainNavi.jsp on Line 61 When a Workbook Is In Edit Mode
DAP-37970

The applicationMarketEnabled variable is now set on the JSP page to resolve this error from being displayed.


(tick) Bug fixed.

8

Some Context Menus Aren't Available After a Failed Workbook Run in Edit Mode
DAP-37988

The context menu is now available after a failed workbook run.


(tick) Bug fixed.

9

Reconfiguring a Partitioned Import Job with Eventual "Save & Migrate" Opens an Infinite Running Job


DAP-38040

In MySQL and HSQL mode, the following actions now work as expected:

  • Clicking "Save & Migrate" on an import job doesn't lead to an eternally running migration job.
  • Compaction jobs run as expected.
  • Normal jobs run as expected.
  • Job scheduling works as expected even when many jobs are triggered and need to be queued.

(tick) Bug fixed.

10

Datameer Needs to Call o.a.h.s.Securityutil.Setconfiguration(Configuration) after Changes to Cluster Configuration
DAP-38047

Datameer now reads the Hadoop configuration property hadoop.security.token.service.use_ip and ensures that the client and cluster settings match.


(tick) Bug fixed.

11

Browse Column Doesn't Work as Expected in Workbooks
DAP-38056

Under the FX tab in the workbook inspector, you can now selected Browse Column and navigate through the workbook sheets.


(tick) Bug fixed.

12

Datameer Creates an Excessive Number of Splits When the Export Source Sheet Is Empty
DAP-38058

When you now export via JDBC, Datameer no longer creates hundreds of splits for the export process in case there isn't input data. If no records are available on export sheet, a maximum of 1 split is created.


(tick) Bug fixed.

13

It Isn't Possible to Create PostgreSQL Tables
DAP-38064

It is again possible to export a worksheet sheet into a table in PostgreSQL.


(tick) Bug fixed.

14

The Filter Indicator Icon Appearing On Incorrect Columns
DAP-38073

The filter icon again appears correctly on filtered columns.


(tick) Bug fixed.

15

Save and Run Fails for Workbooks Without a Source Sheet
DAP-38105

All workbooks can now be saved and run regardless if a source sheet is present.


(tick) Bug fixed.

7.2.6 Release Notes

Improvements

1

Add Spark Execution to Job GraphDAP-37632

The execution framework now appears as "Spark" in the job graph when executing Datameer jobs using Spark Cluster grid mode.


2

Allow Specifying a List of Entity Paths in a Folder for BackupDAP-37705

Users can now select specific files from a folder to backup without having to backup the entire folder.


3

Add Support for Transparent Encryption on Real Time AnalyticsDAP-37905

Support for transparent encryption added for Real Time Analytics.

4

Enable Hive JDBC Connection with ZookeeperDAP-38019

The Hive JDBC plug-in has been update with new class paths.

Bug Fixes

1

Create Non-existing Folder When Creating or Rolling Back a Workbook via REST API v2
DAP-30729

When attempted to create or rollback a workbook via the v2 REST API, and its folder doesn't exist, a folder is now created.

(tick) Bug fixed.

2

Stabilization of the Workbook Settings Wizard
DAP-34306

  • If a duplicate of a data source is added to a workbook, the data source is now only displayed one time.
  • The drop down menu in the workbook settings is no longer cut off and correctly displays all options.

(tick) UI updated.

3

Unable to Edit After Entering Incorrect Principal in Kerberos Hadoop Cluster Settings
DAP-35487

An invalid principal no longer can be successfully saved.

(tick) Bug fixed.

4

Using the Infinity Symbol Breaks Flip Sheets
DAP-36474

A symbol transformer has been added so that the infinity symbol works correctly with flip sheets.

(tick) Bug fixed.

5

Illegal Characters in a Workbook Column
DAP-36922

  • Column names are no longer allowed to contain illegal characters.
  • The SQL sheet editor now highlights the part of the query where the "bad characters" are located.

(tick) Bug fixed.

6

 The Workbook Inspector Is Broken When Deleting a Referenced Column on an RTA Sheet
DAP-37555

It is no longer possible to delete referenced columns from Real Time Analytic sheets.


(tick) Bug fixed.

7

SQL Sheet Syntax Highlighting Identifiing Valid Code as Errors
DAP-37620

  • Error highlighting now ignores column names.
  • Error highlighting now ignores aliases for table names.
  • Column aliases are now highlighted as an error when containing illegal characters.

(tick) Bug fixed.

8

Functions Aren't Producing Data When a Used Datasources Was Deleted from the Workbook
DAP-37753

Functions now show the correct data even when a no longer needed datasource has been deleted from the workbook.

(tick) Bug fixed.

9

Rest API Calls to Create/Update Workbooks Hinder Users Accessing the Workbook from the UI
DAP-37776

When creating a new workbook via REST API v1, the owner is now the acting user. The user is now able to access the workbook immediately in the UI.

(tick) Bug fixed.

10

The Warning Dialog Is Missing in Case of a 403 Error When Creating a New Workbook or Worksheet
DAP-37846

In case of an error, a dialog now appears and informs users of the problem.

(tick) Bug fixed.

11

The Dependency View Flashes 404 Errors When Deleting a File
DAP-37899

  • Only a single error is now displayed.
  • The dependencies are now displayed for the currently selected file.
  • Loading the dependencies dialog is no longer permanently displayed.

(tick) Bug fixed.

12

SQL Sheet Error: IllegalArgumentException: Unable to Coerce '200001' to a Double Value


DAP-37907

The following SQL joins between key columns of different types are now supported:

  • String
  • Integer Float
  • Big (Decimal | Integer)

(tick) Bug fixed.

13

SQL Queries Are Missing from Job Traces
DAP-37916

  • The v2 JSON representation of the workbook and its direct dependencies are now included in the job trace ZIP file.
  • The v1 JSON files in the job traces now provide backwards compatibility.

(tick) Bug fixed.

14

Intermittent Issue with File Uploads after Switching on Native Multi User Mode
DAP-37930

Datameer now explicitly calls a function from the Java runtime library to open connections to HDFS that correct the intermittent issues.


(tick) Bug fixed.

15

The Union Operation Fails with the Error: java.lang.IndexOutOfBoundsException
DAP-37932

Union sheets are now being processed successfully.


(tick) Bug fixed.

16

The Documentation Links for Azure are Outdated
DAP-37937

The links in the Azure help text now point to the correct documentation pages.

(tick) Bug fixed.

17

The Sheet Tab in the Workbook Inspector Doesn't Show the Sheet Type Info for Union Sheets
DAP-37950

The sheet type is now displayed in the inspector for union sheets.

(tick) Bug fixed.

18

Not Possible to Get Dependencies for a Workbook after Injecting It via REST v1
DAP-37956

It is now possible to request workbooks dependencies with the v1 REST API.

(tick) Bug fixed.

19

There Isn't a Context Menu after Renaming a Column
DAP-37958

The context menu is now displayed correctly.

(tick) Bug fixed.

20

Can't Upgrade to Datameer-7.2.5: org.hibernate.HibernateException: Wrong column type in dap.accept_terms for column is_accepted. Found: Bit, Expected: Boolean
DAP-37960

Datameer now handles the database schema correctly allowing for a successful upgrade.

(tick) Bug fixed.

21

The Documentation Link for "About Custom Properties" In the Hadoop Custom Property Setting Is Out of Date
DAP-37985

The link in the custom properties help text now points to the correct documentation page.

(tick) Bug fixed.

22

Recreating a Workbook via Rest v1 Doesn't Respect Custom Column Names on Joined Sheets
DAP-37994

Custom column names now remain on joined sheets.

(tick) Bug fixed.

23

Closing a Workbook Tab Doesn't Work in Edit Mode for Existing Workbooks
DAP-38006

The close button in the Workbook UI now correctly closes the tab.

(tick) Bug fixed.

24

Configuring the Distributed Mode in default.properties Doesn't Work for the First Startup
DAP-38009

Configuration of the default.properties file is now available after the first startup.


(tick) Bug fixed.

25

Workbook Is Broken for NaN Input
DAP-38032

Workbooks now work correctly when users enter NaN characters into the multiline editor.

(tick) Bug fixed.

26

Reconfiguring a Partitioned Import Job with the Setting "Save & Migrate" Opens an Infinite Running Job
DAP-38040

Selecting "Save & Migrate" no longer leads to an eternally running job.

(tick) Bug fixed.

7.2.5 Release Notes

Improvements

1

Improve Performance of Upgrade72ColumnMigrationDAP-36882

  • Improved performance of Upgrade72ColumnMigration.
  • Workbooks with more than 2000 columns can now be migrated in a suitable time (2-4min).
  • Columns that have been in error before are also in error after the upgrade.
  • Columns without errors are still without error after the upgrade.
  • SQL sheets without errors and with errors now migrate successfully.

2

Create Extension Point to Allow for Plug-ins to Set PermissionsDAP-37529

  • Created an extension point that sets permissions.
  • Enabled plug-in creation for sharing and permissions.

3

Remove SparkClient and SparkCluster Execution FrameworksDAP-37657

SparkClient and SparkCluster execution frameworks have been removed from Datameer.

4

Create a REST API Call to Set "View Full Results" On a WorkbookDAP-37616

New REST API call created to view the full results of a workbook.

5

Support Server-Side Operations on Spark: DependenciesDAP-37635

The new framework, Spark cluster, now supports server-side operations.

6

Track S3 Read and Write Operations in Job CountersDAP-37656

Updated the read and write ops to enable reporting and tracking S3 calls made during job executions.


7

Allow Triggering Jobs by Path via RestDAP-37704

A new REST API call allows triggering jobs via PATH or ID.


Bug Fixes

1

The Functions GROUPFIRST and GROUPLAST Are Returning the Wrong Results for Lists
DAP-34553

These functions now return the correct results for all data types.


(tick) Bug fixed.

2

Multiline Editor UI Issues
DAP-36837

  • The "OK" button is now enabled when input changes and the input isn't empty.
  • The shortcut "Cmd+Enter" is now disabled as long as "OK" button is disabled.
  • Autocomplete no longer truncates the data type.

(tick) UI updated.

3

The Partition Dialog in the Workbook Settings Show Invalid Formulas on Re-open after an Error Message
DAP-37531

The partition dialog now saves and displays valid formulas.


(tick) Bug fixed.

4

Previews in Workbooks Aren't Generated for Empty Date Columns
DAP-37558

Previews are now generated correctly before and after running a job.


(tick) Bug fixed.

5

SQL Sheet Syntax Highlighting Identifies Valid Code as Errors
DAP-37620

Error highlighting now ignores aliases for table names.


(tick) Bug fixed.

6

Can't Create a Hive JDBC Connection
DAP-37643

Hive connections can now be made again.


(tick) Bug fixed.

7

A Workbook Must Disable "Process Now" in the Settings If Users Don't Have Execute Capability
DAP-37645

The workbook now disables the "Process Now" setting for ineligible users.


(tick) Bug fixed.

8

The Warning Dialog Is Missing for 403 Errors in Workbooks
DAP-37653

The warning message now appears were applicable to explain the problem to users.


(tick) Bug fixed.

9

In Workbooks, the Non Existing Sheet Error is Only Displayed on Refresh


DAP-37666

If a workbook encounters a non existing sheet error, it is now displayed immediately.


(tick) Bug fixed.

10

Logging in after a Session Timeout Doesn't Redirect Back to the Details Page
DAP-37667

Users now get redirected to the last visited page (job details page) after a session timeout.


(tick) Bug fixed.

11

Visual Explorer's Functionality Should Be Disabled While the Chart Preview Dialog Is Open
DAP-37672

While the chart preview dialog is open, other Visual Explorer functionalities (filters, create sheet, etc) are now disabled.


(tick) Bug fixed.

12

For the GIT Versioning Plug-in, Building Snapshots of File Browser Artifacts Block Jobs Triggering
DAP-37686

  • The number of event bus threads GIT plugin might use are now limited to prevent blocking other processes.
  • If the event-bus is overwhelmed, the job scheduler now continues to run.

(tick) Bug fixed.

13

An Error is Given When Returning to the Admin Tab After Leaving It
DAP-37687

When returning to the Admin tab, if the Administrator was doing any operation on that tab before, the operation is "forgotten" and the user is presented the selection menu of the Admin tab where they were when last leaving the page.


(tick) Bug fixed.

14

Error in Workbook after Changing the Partition of an Imported Worksheet
DAP-37721

  • If a change in the partitioning causes a current selection to return no results, the worksheet is now displayed as empty.
  • If an advanced expression causes a partition selection to have no results, the worksheet is now displayed as empty.

(tick) Bug fixed.

15

Can't View Data in a Workbook Without Read Access to the Source
DAP-37741

Users with access to a worksheet can now read it even if they don't have access to the data source.


(tick) Bug fixed.

16

The Multiline Editor's Autocomplete List Covers Session Expired Dialog
DAP-37743

The autocomplete list no longer covers session expired dialog.


(tick) Bug fixed.

17

 The Inspector Doesn't Refresh after Deleting Multiple Files in the File Browser
DAP-37744

The browser inspector now shows the correct folder information after deleting multiple files.


(tick) Bug fixed.

18

UserManagement.updateLoginDateAndCountIfPossible(String): Race Condition at Database Operations
DAP-37750

Logging in works as expected and no longer fails.


(tick) Bug fixed.

19

Export Job Failure - Failed to Move Exception from datameer.dap.sdk.util.FileOutputAdapter.finalizeExport


DAP-37767

Export jobs related to the "failed to move" exceptions from S3 exports are now successful.


(tick) Bug fixed.

20

Duplicates Displayed in Groups Display
DAP-37786

Groups are now only displayed one time.


(tick) Bug fixed.

21

NormalJobDriver before StartJob Uses the Wrong User for the Permission Check
DAP-37788

The permissions check now checks the correct user and guarantees that the jobs don't run with outdated data.


(tick) Bug fixed.

22

Most Functionality with Workbook Settings Is Broken in Internet Explorer 11


DAP-37799

All functionalities are now working on configure/settings page when using Internet Explorer 11.


(tick) Bug fixed.

23

Misleading Message When Creating a Union from Multiple Sheets
DAP-37806

The message has now been updated to be more clear.


(tick) Bug fixed.

24

Fix the Broken Math Functions on SQL Sheets
DAP-37807

The following functions are now supported and follow the SQL spec:

  • MOD()/% Only accepts exact values (E.g., Decimal or Integer.) It doesn't support inexact floating point values. A cast must be used to go from double to decimal if MOD() is used. The resulting type is the type of the denominator.
  • CEIL()/FLOOR() Accepts all numeric types. Decimal and Integer arguments result in an Integer result value. Double arguments result in a Double result value.
  • ROUND() Accepts all numeric types and an optional integer precision parameter. The result type is the same as the argument type.
  • SIGN() Accepts all numeric types. The result type is the same as the argument type.
  • TRUNCATE() Accepts all numeric types. The result type is the same as the argument type.
  • ROUND() function has added support for setting the precision like ROUNDUP() and ROUNDDOWN() functions.

(tick) Bug fixed.

25

Clicking on Dependency Graph While a SQL Sheet Is in Error Causes the Workbook to Error
DAP-37817

The problem has been resolved and an error in a SQL sheet no longer causes the entire workbook to error.


(tick) Bug fixed.

26

The Sheet Type "Information" Is Missing for External Worksheets in the Workbook Inspector
DAP-37819

The sheet type "Information" is now displayed correctly.


(tick) Bug fixed.

27

The App Market Tab Breaks Datameer Tabs and the Menu in Internet Explorer
DAP-37824

The App Market tab is now disabled by default in live mode.


(tick) Bug fixed.

28

Missing the Error Dialog for Range Joins When All of the Columns Are Excluded
DAP-37833

  • Error dialog now pop ups where applicable.
  • Join sheets are no longer created if all columns are excluded.

(tick) Bug fixed.

29

SmallJob Can't Be Selected as an Execution Framework


DAP-37838

Setting das.execution-framework=SmallJob (at cluster or job level) again executes jobs with the SmallJob framework.


(tick) Bug fixed.

30

It Isn't Possible to Rename Columns of a Worksheet If the Sheet Has Dependencies 
DAP-37859

  • It is now possible to rename any column on duplicated sheets (referenced or not referenced).
  • The column rename is now reflected immediately on Smart Analytic sheets.

(tick) Bug fixed.

31

The Sheet Type "Information" in Copy Sheet Dialog Is Missing for Sql and Transformed Sheet
DAP-37883

The sheet type "Information" for SQL and transformed sheets in the copy sheet dialog are now displayed correctly.


(tick) Bug fixed.

32

Renaming Column Issues in Workbooks


DAP-37895

  • It is now possible to duplicate a sheet after a column rename.
  • Duplicated worksheet dialogs now display the latest column names.
  • Datameer now displays the latest column name immediately on flip sheets.
  • It is now possible to rename any column on duplicated sheets (referenced or not referenced).
  • Column renames are now reflected immediately on Smart Analytic sheets.

(tick) Bug fixed.

33

SQL Queries Are Missing from Job Traces on SQL Sheets Using the V1 JSON Structure
DAP-37916

The V2 JSON representation of the workbook and its direct dependencies are now included in the job trace ZIP file.


(tick) Bug fixed.

7.2.4 Release Notes

Epics

1

[REST] Response of "Create" Commands Should Contain FileID & UUIDDAP-31416

Change REST Call for Create ConnectionDAP-36258

Change REST Call for Create Import/Link/UploadDAP-36259

Change REST Call for Create Export JobDAP-36260

Improvements

1

Support Encryption in S3 Connector to Avoid 403 Forbidden Error in Encrypted BucketDAP-37569

Encryption now supported for the S3 connector.

2

Multiline Editor - Update Line HeightDAP-37509

The line height of the formula editor has been updated.

3

Expand SQL Function Autocomplete List in the WorkbookDAP-37579

Functions now highlight properly in the SQL editor.


4

Improve RecordSchema Builder PerformanceDAP-37662

The performance for building schemas in workbooks has been improved.

5

Improve Workbook Context PerformanceDAP-37683

The performance for building schemas in workbooks has been improved.

6

Optimize CompiledSheet.getColumnId and RecordSchema.columnDAP-37709

The performance for building schemas in workbooks has been improved.

Bug Fixes

1

Restoring a Folder via REST Adds a Workbook History Entry
DAP-35460

A workbook history entry is no longer created when restoring a folder.


(tick) Bug fixed.

2

Deleting a File Upload Doesn't Delete the Original File
DAP-35874

The original files are now removed in the same time frame as the Parquet files.

  • Header files are deleted.
  • Deletion happens within the next housekeeping run.
  • After the deletion in the UI, there is an entry in file system artifacts to delete tables that need to be deleted.
  • Doesn't delete files which were associated with an file upload. Only the upload is deleted.

(tick) Bug fixed.

3

Unclear Log4j Error When Running Bin/Secure/Unsecure HDFS Tool
DAP-36325

The tool no longer produces an error.


(tick) Bug fixed.

4

Not Possible to Use a Scrollbar to Autocomplete in the Formula Editor When Using Internet Explorer
DAP-36483

It is now possible to use the autocomplete scrollbar in the formula editor when using Internet Explorer.


(tick) Bug fixed.

5

Workbooks Fail When Using a Partitioned Data Link with the Setting "Defer Sample Generation to Workbook'
DAP-36590

When using a partitioned data link it is only possible to generate the sample immediately. Now, the "Defer Generation" option is unavailable.


(tick) Bug fixed.

6

Workbook Error-sheet: Font Color Switching When Hovering to Another Sheet Tab
DAP-36924

The font color now stays red as expected.


(tick) Bug fixed.

7

Twitter REST API: Unable to Generate Authentication Token
DAP-37139

The Twitter plug-in has been updated to allow for token authentication.


(tick) Bug fixed.

8

CAPTCHA Flag Isn't Cleared Properly
DAP-37151

CAPTCHA now working as expected.


(tick) Bug fixed.

9

Workbooks Fail with 'Timeout Waiting for Connection' Error


DAP-37249

The timeout error has been corrected.


(tick) Bug fixed.

10

The SQL Sheet Interprets Column Named 'user' as a Function
DAP-37258

The word "user" is no longer interpreted as a function.


(tick) Bug fixed.

11

Don't Allow a Blank SheetID via REST API PUT Command
DAP-37358

The API won't call to blank out sheetID since as it is a required field.


(tick) Bug fixed.

12

No Session Timeout Appears When Viewing Workbook Job Run Details
DAP-37379

A session timeout indication is now displayed anytime a session timeout happens.


(tick) Bug fixed.

13

Validation Errors Aren't Shown for the Remote Data Browser Property
DAP-37387

Validation errors are now shown in the remote data browser property component.


(tick) Bug fixed.

14

Workbooks Intermittently Fail after Upgrading with a "Container Is Running Beyond Physical Memory Limits" Exception
DAP-37395

The Parquet library has been updated to 1.8.3 to ensure OOM(s) don't occur from compression handler leaks.


(tick) Bug fixed.

15

Parquet Files with a Decimal(15,0) Column Can't Be Ingested
DAP-37432

Parquet files with this file type can now be ingested.


(tick) Bug fixed.

16

It Isn't Possible to Drag Widgets on the Canvas If a User Clicks on the Widget Icon in Infographics
DAP-37485

Now possible to drag widgets on the canvas at anytime.


(tick) Bug fixed.

17

Documentation Link for Custom Function Is Shown but No Endpoint
DAP-37504

Documentation links are no longer autogenerated for custom functions.


(tick) Bug fixed.

18

Font Size Issue in the Formula Editor
DAP-37508

Font size for all characters including commas are now the same.


(tick) Bug fixed.

19

Smart Analytics and Format Cell Dialogs Don't Close in Case of a 403 Error


DAP-37530

If a 403 error occurs, the dialog closes or the warning appears on top of the dialog.


(tick) Bug fixed.

20

An Error is Displayed in the UI If a Group Can't Access a Folder
DAP-37543

A warning rather than a error is now displayed when a group can't access a folder.


(tick) Bug fixed.

21

Clicking on the Autocomplete Input Scrollbar in the Inspector Closes the Dropdown Menu
DAP-37559

The drop-down menu with suggestions stays open when clicking on the scrollbar.


(tick) Bug fixed.

22

Renaming a Source Column Breaks SQL Sheets When the Column Reference Has a Table Alias


DAP-37561

Renaming a column no longer breaks a SQL sheet.

(tick) Bug fixed.

23

The Spark App Continues to Run Even When Canceled from Datameer's UI
DAP-37566

The job now cancels and releases resources as expected.


(tick) Bug fixed.

24

The Treemap Doesn't Have Tooltips
DAP-37567

Tooltips have been added to Treemaps.


(tick) Bug fixed.

25

"Run" Button for Unsaved Workbooks Is Disabled
DAP-37602

The "run" button is now working correctly.


(tick) Bug fixed.

26

Data Driven Jobs Aren't Triggered If a Dependency Triggers a Permissions Exception
DAP-37605

The scheduling and triggering of subsequent jobs is now working as expected. This update continues to ensure that sharing and permissions security is respected.


(tick) Bug fixed.

27

The "Sheet Column" Context Menu Is Out of Position When Scrolling Horizontally
DAP-37611

Context menu works correctly when scrolling.


(tick) Bug fixed.

28

Renamed Columns Have the Old Name in the Join Dialog
DAP-37614

Renamed columns are now renamed in all dialogs immediately after the renaming occurs.


(tick) Bug fixed.

29

Renaming SQL Sheet Column Results Doesn't Trigger Column Reference Updates


DAP-37622

Renaming SQL sheet columns now triggers reference updates as with other sheet types.


(tick) Bug fixed.

30

Schedule Inspector: Error in the Console When Saving
DAP-37626

No errors occur when saving with the schedule inspector.


(tick) Bug fixed.

31

It Isn't Possible to Adjust Filters When the Filters Result in an Empty Sheet
DAP-37674

It is now possible to edit fillers at all times, even if the resulting sheet is empty.


(tick) Bug fixed.

32

Housekeeping Fails with Exception Because of Unsaved File Uploads


DAP-37688

Deletion no longer fails when no files are attached.


(tick) Bug fixed.

7.2.3 Release Notes

Improvements

1

Increase Timeout for Scanning AnnotationsDAP-37466

Added increased timeout parameter to the start.ini


2

Upgrade Parquet to 1.8.3DAP-37498

Datameer has upgraded to the more stable Parquet 1.8.3

3

REST API Job-details Should Include Datameer Configuration ID, File ID & UUIDDAP-31203

The REST API job-details call now delivers the additional <configuration-id>, <file-id>, and <uuid> information.


4

Add Load Indicator Before Opening the Visual Explorer DialogDAP-36815

A load indicator has been added when opening Visual Explorer.


5

Flexible Height and Positioning for Auto-complete Input Fields Drop MenuDAP-36949

Auto-complete drop menu updated.


6

Show User a Warning If the CSRF Token Is Expired - AJAXDAP-36969

  • If the CSRF token is expired/invalid an error message is displayed.
  • The option to cancel was added.
  • Datameer differentiates between handling between HTML and AJAX posted requests.

7

Show User a Warning If the CSRF Token Is Expired - HTML FormDAP-37041

  • If the CSRF token is expired/invalid an error message is displayed.
  • Datameer differentiates between handling between HTML and AJAX posted requests.
  • Users can now force to reach the page by using the URL http://localhost:8100/general/invalid-session or on invalidating the CSRF token between wizard pages jumps.

8

Support Datameer BIGINTEGER Columns in SQL SheetsDAP-37243

Workbooks with a sheet that contains a big integer column are now consumable within a SQL sheet.


9

Add Support for CDH 5.14.4DAP-37374

Support added for CDH 5.14.4.


10

Connect to S3 Via a Network ProxyDAP-37456

Datameer can now connect to S3 via a network proxy.


11

Updated 403 Responses in WorkbooksDAP-37458

403 response now produces an error message in workbooks.


12

Avoid a Flash Message for HTTP-403 ErrorsDAP-37472

  • 403-errors show the common CSRF-Token dialog.
  • A flash message no longer appears.
  • Other error codes (like 500) still produce the expected flash message.

Bug Fixes

1

User Role Name Can't Be a Blank Space
DAP-31822

Users can no longer save a blank space as a valid username.


(tick) Bug fixed.

2

Progress Bar While Duplicating Infographics Doesn't Progress
DAP-31901

The progress bar now reflects the current progress.

(tick) Bug fixed.

3

Admin Mail Server Settings: Missing Asterisk (*) on Required Fields
DAP-32535

All required fields for setting up admin mail server settings have an asterisk.


(tick) Bug fixed.

4

Analyst Role Can Change Ownership of Files with the REST API But Not UI
DAP-32715

Users now have the ability to change ownership of an artifact from the role of Analyst made consistent throughout the product by adding the ability to the UI.

(tick) Bug fixed.

5

Anonymous Users Shouldn't Be Able to Reach "About Datameer" Dialogue
DAP-32819

Anonymous users can no longer access "About Datameer" information.


(tick) Bug fixed.

6

Manually Typing a Color Code in an Workbook Input Field Always Resets to #808080
DAP-33377

The input value is now retained correctly.


(tick) Bug fixed.

7

Column Name Shows up Twice after Removing Another Column Name
DAP-34628

  • Column names are no longer duplicated after removing a previous column.
  • '1' is added to a column name when a column with same name is present after the previous column was deleted.

(tick) Bug fixed.

8

The Conductor.sh --profile-memory Isn't Creating Memory Profiling Snapshots
DAP-34913

A created snapshot now contains object allocation information. (snapshots are located in user home folder /Snapshots)


(tick) Bug fixed.

9

Disable Drop-down Menu for Scheduling If the User Has No Write Permissions
DAP-35908

Disabled all options when the user has no permissions to change the scheduling.


(tick) Bug fixed.

10

Thousand Separators for Cell Formatting is Incorrect
DAP-36726

The checkbox now reflects the current setting.


(tick) Bug fixed.

11

When Duplicating a Sheet with Formulas, References to the Original Sheet Remain in the Formulas of the New Sheet
DAP-36743

Now when copying sheets with formulas, the formulas with references to the sheet being copied are renamed on the new sheet to have the name of the new sheet.


(tick) Bug fixed.

12

Autocomplete Doesn't Auto-close When Applying Formulas via Cmd-Enter
DAP-36755

Autocomplete now auto-closes after applying formulas via Cmd-Enter.


(tick) Bug fixed.

13

Exports Fail on Kerberos Secured Impersonated Environment From HiveServer1
DAP-36787

Exports to Hive over a HiveServer1 connection on Kerberos Secured Cluster with impersonation are now able to create new table and export data.


(tick) Bug fixed.

14

Inconsistent Behavior When Users Try to Delete a Sheet
DAP-36797

  • When the very last sheet in the workbook is an empty SQL sheet, the Delete context menu item is now enabled.
  • An empty formula sheet (Sheet1) will be displayed after deleting the SQL sheet.

(tick) Bug fixed.

15

There Is Meaningless Error Dialog When Users Add an Import Job with No Data into a Workbook
DAP-36823

Error dialog no longer displayed.


(tick) Bug fixed.

16

Error When Opening a Datasource Sheet Based on an Empty Partitioned Import
DAP-36824

  • Error message no longer displayed.
  • Status bar message is now consistent for a sheets between initial workbook load and switching to the sheet.
  • For sheets with empty (no data) partitions selected, the status bar renders a link to open the partition selection dialog.

(tick) Bug fixed.

17

Close the Workbook Context Menu When Users Navigate to Another Column
DAP-36850

The context menu now closes when users navigate to another column.


(tick) Bug fixed.

18

Error While Processing a Workbook When One of the Partition Fields Is Left Blank
DAP-36871

The OK button is now disabled in the partition of sheet dialog if not all fields are configured.


(tick) Bug fixed.

19

Sheet Rename Breaks the Layout When an Empty Column Is Hidden
DAP-36873

The layout no longer breaks.


(tick) Bug fixed.

20

Worksheet Status Bars Shows Inconsistent an Message for the Same Sheet with an Error
DAP-36923

  • Sheet status bars now show consistent messages and colors.
  • Sheets with errors don't display the "Run Workbook" message or link.

(tick) Bug fixed.

21

Navigating with Key Arrows Up/Down Doesn't Work in the Function List in the Fx Inspector Tab
DAP-36950

Using the up/down arrows in the function list work correctly.


(tick) Bug fixed.

22

Error When Renaming a Column in Joined Sheets with Excluded Columns
DAP-36967

Error no longer occurs when renaming a column in a joined sheet.


(tick) Bug fixed.

23

SQL Sheets: No Error Shown When a Dependent Sheet Has a Column Error
DAP-36997

The SQL sheet is now in error state (red) when creating from a formula sheet with an error.


(tick) Bug fixed.

24

Error in js Console on the Details Page When "Rerun Migration" Is Available
DAP-37014

  • No longer an error in the js console.
  • No longer displaying the partition pie chart when a migration job fails.

(tick) Bug fixed.

25

 TopN Sort Functionality Doesn't Work on Visual Explorer Sheets
DAP-37036

TopN sort works correctly in Visual Explorer worksheets.


(tick) Bug fixed.

26

Existing Worksheets Disappear When Users Add Data into a Workbook
DAP-37045

Default formula sheets are removed when a data source sheet is added if:

  1. It is empty.
  2. It is the the only sheet of the workbook.

(tick) Bug fixed.

27

Show Detailed Information in Case of a Non-2xx Response in Visual Explorer
DAP-37047

  • An error dialog is displayed when opening Visual Explorer with a timed out session.
  • Error dialog isn't displayed when:
    • Users click on "Drill" context menu with a timed out session.
    • Users click on Undo/Redo buttons.
    • Users select a chart in the Chart Previews dialog
  • Error message says "401 Unauthorized".

(tick) Bug fixed.

28

Renaming a Source Column Breaks SQL Sheets When Used as a Statement
DAP-37052

SQL statements are now adapted to the new column name.

(tick) Bug fixed.

29

The Formatting of Columns Isn't Applied When a Sheet Is Duplicated
DAP-37086

Duplicated sheets now apply all settings and formatting from the original sheet.


(tick) Bug fixed.

30

Dependencies for Files in the File Browser Aren't Updated When Copy/Pasting a Folder Within the Root Folder
DAP-37096

Dependencies now update when copy/pasting a folder within the root folder to somewhere else in the root folder.


(tick) Bug fixed.

31

An Error Message Overlaps with the Inspector When Resizing the Browser or On a Small Screen
DAP-37109

Error message no longer can overlap the inspector.


(tick) Bug fixed.

32

Export Jobs Based on the Hive1 Connector Don't Have the Replacement_policy Property Added after a 6.1 -> 7.1 Upgrade
DAP-37168

Upgrade exports older than version 7.1 now migrate the old overwrite flag for HiveServer1 and HiveServer2 connections based the export job to replacement_policy.


(tick) Bug fixed.

33

Compaction Jobs Possibly Corrupting Source Data
DAP-37174

Issue resolved, compaction now working as intended.


(tick) Bug fixed.

34

License Upload in the UI Isn't Secured by CSRF Token
DAP-37194

License uploads now secured by CSRF token in the UI.


(tick) Bug fixed.

35

The Move Sheet Action Closes the Browse Column Tab and Can Lead to an Error
DAP-37199

Inspector now working as expected without errors.


(tick) Bug fixed.

36

Issues When Exchanging an External Sheet When It Has Upstream Dependencies
DAP-37204

  • External sheets are always exchangeable.
  • Partitions are changeable.

(tick) Bug fixed.

37

The Info Dialog When Visual Explorer Can't Open Still Shows "Run Workbook" Button
DAP-37217

  • The dialog now shows a detailed message provided with the exploration status by either:
    • displaying the reason provided by the exploration status.
    • displaying a universal (neutral) message and has a collapsible section with a detailed message.
  • The "Run Workbook" button is only enabled when a workbook run fixes the missing requirement (e.g., no data available).

(tick) Bug fixed.

38

Infographic Charts Are Missing the Context Menu when Right Clicking
DAP-37227

The context menu now pops up with a right click for both empty and populated infographic charts.


(tick) Bug fixed.

39

Folder Copy and Duplication Feature Doesn't Update the Data Source for Infographics
DAP-37250

Using the copy or duplicate feature on a folder that contains all artifacts now updates all references in an infographic to use the new copy of the data source.


(tick) Bug fixed.

40

The File Browser Is Missing the Abort Icon
DAP-37260

The Abort icon is visible and functional.


(tick) Bug fixed.

41

A Double-click on a Formula in a Read Only Sheet Applies the Formula On the Wrong Sheet
DAP-37274

Formulas are applied on the correct sheet.


(tick) Bug fixed.

42

Post 7.1.5. Upgrade: Can't Submit Any Job Due to Java.Lang.OutOfMemoryError: Java Heap Space
DAP-37277

OutOfMemoryError problem has been corrected.

(tick) Bug fixed.

43

TDE Export: Make the Temporary File Location Configurable
DAP-37284

  • The location where temporary TDE files should be stored is configurable via the properties file:
    • das.tde-export.temp-location=/path
  • If a property isn't set, the default system property java.io.tmpdir is used.

(tick) Bug fixed.

44

Adding an Incorrect Formula Clears the Formula Sheet - No Column Error Is Shown


DAP-37312

Incorrect formulas now display the correct column error message.


(tick) Bug fixed.

45

Session Timeout: Login Redirection


DAP-37319

When logging in to Datameer, the session refreshes to ensure correct authentication procedures.


(tick) Bug fixed.

46

Remove Folder Group Permissions with the "X" Button in the Inspector Doesn't Work
DAP-37321

Removing group permissions for folder via x button works as expected.


(tick) Bug fixed.

47

Due to Broken Logic, upgrade_db.sh Isn't Reading default.properties
DAP-37327

The script now reads the default.properties correctly so users don't have to specify cli arguments if they have already configured their default.properties file.


(tick) Bug fixed.

48

upgrade_db.sh Logic for Reading system.property.db.password Doesn't Allow Special Characters
DAP-37328

Passwords containing "#", "!", or both now work with the script when it is reading the password from default.properties.


(tick) Bug fixed.

49

Copied Data-driven Workbooks Causes a Job Scheduler Issue When It's Triggered Together with the Original Artifact
DAP-37332

Copied workbooks no longer cause a Job Scheduler issues. If any problems arise, clear warnings are show about needed configuration changes.

(tick) Bug fixed.

50

Incorrect Warnings about a Changed Owner in the File Browser
DAP-37339

  • No warning displayed when the owner hasn't changed.
  • Warning only given when trying to change ownership of the /Users folder or of an individual user's home folder /Users/userA.

(tick) Bug fixed.

51

A Default Selected Column Auto Switches in the Formula Sheet When Using Browse Columns Functionality
DAP-37347

Functionality is now similar as if a user was using auto-complete instead (columnA is selected, a new column with the formula is created in columnA).


(tick) Bug fixed.

52

Renaming a Source Column in Complex SQL Statements Break the SQL Sheet
DAP-37352

Renaming columns in the data source doesn't break SQL sheets.


(tick) Bug fixed.

53

Changing Artifact Owner Doesn't Work
DAP-37359

Changing the owner of a file works as expected.


(tick) Bug fixed.

54

The 7.2 Upgrade Script for Column Migration Fails If a Formula Sheet Has Duplicate Column IDs
DAP-37363

The MySQL and HSQL upgrade scripts adjust the column IDs to be unique.


(tick) Bug fixed.

55

Upgrade72ColumnMigration Fails for Long Column Names
DAP-37390

The max column size 255 characters.


(tick) Clarified.

56

A Hive JDBC Connector Configuration Is Lost after Upgrading from DM 7.1.5 to Dm 7.2.2
DAP-37396

Connection strings now remain as they were and the database is cleaned up after upgrading.


(tick) Bug fixed.

57

Pop-up "Tips" In the Smart Analytics Dialog Appear Behind the Dialog Box
DAP-37415

Tool tips now appear over the preview dialog box as expected.

(tick) Bug fixed.

58

Datameer /bin Scripts Contain Broken Logic
DAP-37416

Scripts have been update and work as expected.


(tick) Bug fixed.

59

Datameer 7 with MapR 6 Packages Build with the Wrong MapR Version Jar Files
DAP-37422

Datameer 7.x versions are packaged with the correct MapR jar files.

(tick) Bug fixed.

60

Incorrect Result When Applying GROUPROWNUMBER() Function
DAP-37428

Results are now correct when applying the function GROPUROWNUMBER.


(tick) Bug fixed.

61

Blank Tables and Errors in the js Console on the Details Page of Workbooks and Export Jobs
DAP-37454

There are no longer any errors in the js console and the correct data is displayed on the details page of workbooks and export jobs.


(tick) Bug fixed.

62

Decision Tree Isn't Populating with Data
DAP-37457

Decision tree working as expected.


(tick) Bug fixed.

63

Renaming Columns with Tab Key Is Broken
DAP-37467

  • Pressing the Tab key while the rename input field is active selects the next header to rename.
  • Shift + Tab selects the header before the current selected header.

(tick) Bug fixed.

64

The Time Based Partition Icon Isn't Present on Settings Page in a Workbook after Reloading the Page
DAP-37477

It is now possible to set partitions on the workbook settings page and the top header and the menu are present after a page reload.


(tick) Bug fixed.

65

The Run Workbook Button Is Displayed but Doesn't Work in the Info Dialog for Users with No Permissions
DAP-37486

The run workbook button is no longer present in info dialog for users with no permissions.


(tick) Bug fixed.

66

Left Outer Join in InSheetSQL Returns Far More Rows than Expected
DAP-37494

InSheetSQL now returns the correct amount of data.


(tick) Bug fixed.

67

Execution Graphs for SQL Sheets Contain Mostly Identity Elements
DAP-37506

No identity graph elements are shown for SQL sheets.


(tick) Bug fixed.

68

Spark Jobs Fail for S3 Storage
DAP-37542

Spark cluster now supports S3 as storage.


(tick) Bug fixed.

7.2.2 Release Notes

Improvements

1

Add Support for MapR 6.0.1 along MEP 5.0DAP-36793

Support added support for MapR 6.0.1 along MEP 5.0

2

Add Support for CDH 5.15DAP-37183

Support added for CDH 5.15

3

Create CSRF Tokens Per RequestDAP-36910

REST API authentication now requires CSRF token when authenticating with session cookies.


4

Add Snowflake Plug-in to Official Datameer ReleaseDAP-37121

Snowflake plug-in added to the official Datameer release.


5

Upgrade Plug-in Tensorflow to Use TensorFlow 1.7DAP-36948

The TensorFlow plug-in now supports TensorFlow 1.7.


6

Add More Details to a FileNotFoundException When a Command Fails During SSH ExportDAP-36958

Additional details added explaining the cause of the error.


7

Extend Session Timeout on Page RefreshDAP-36999

Refreshing the page in Datameer now resets the timeout clock.


8

Add Support for HDP 2.6.5DAP-37102

Support added for HDP 2.6.5


Bug Fixes

1

Session Trapping
DAP-22900

The session identifier always changes after a users successfully logs in.


(tick) Bug fixed.

2

Condense Fields "Host", "Port" And "Url Properties" on JDBC Connector
DAP-32572

JDBC connector fields updated.


(tick) Bug fixed.

3

Copying a String Values in the File Browser with CMD-C Failing
DAP-34226

Command CMD + C no longer blocked when selecting text.


(tick) Bug fixed.

4

The Job Log on the Details Page Polls Without Waiting for the Previous Poll to Finish
DAP-35928

A poll will no longer happen before the previous poll has finished.

(tick) Bug fixed.

5

Autocomplete and the Multiline Editor Have Issues with a Vertical Scrollbar
DAP-36346

A poll will no longer happen before the previous poll has finished.


(tick) Bug fixed.

6

"Append with Sliding Time Window" Retention Policy is Causes a NullPointerException
DAP-36437

An import job now runs with empty and will keep at least N results field.


(tick) Bug fixed.

7

The Column Name Automatically Changes Its Name on Applying Formula
DAP-36482

The column name no longer automatically changes when applying a formula.


(tick) Bug fixed.

8

Disabling Partitioning on an Import Job or a Data Link Breaks the Workbook
DAP-36581

The workbook now shows the preview of the unpartitioned workbook and the partition button is disabled.


(tick) Bug fixed.

9

When Moving Artifacts to a Different Folder, the Name of the Last Moved File Is Taken for the Next File to Be Moved
DAP-36582

Moving files to a different folder now use the right names of the files to be moved.


(tick) Bug fixed.

10

 Sorting on a Real Time Analytics Sheet Doesn't Show Sorted Records in the Preview
DAP-36602

Sorted records are now shown correctly in the preview.


(tick) Bug fixed.

11

IndexOutOfBoundsException When Sorting a Formula Sheet with Dummy Column
DAP-36608

  • Sorting a formula sheet with dummy columns now works correctly.
  • Dummy columns now disappear as intended when creating a new sorted sheet.

(tick) Bug fixed.

12

Not Possible to Create SQL Sheets If One of the Unrelated Columns Is in an Error State
DAP-36618

It is now possible to create SQL sheet from an fx column even if one of the columns (unrelated) on fx sheet is in an error state.

(tick) Bug fixed.

13

When a SQL Query is Incomplete in a Workbook There Is an Error on the Referenced Sheet
DAP-36622

The data source now correctly shows no error when a SQL query has been started but is not yet finished.


(tick) Bug fixed.

14

Wrong Syntax Highlighting in Multiline Editor for Formulas with a Dot Inside/ Nested Formulas
DAP-36650

Formulas now appear as expected.

(tick) Bug fixed.

15

Line Chart with Dates Displays Multiple Labels with the Same Date
DAP-36677

Line charts that have dates now display a single label for a date.


(tick) Bug fixed.

16

Stop Polling When Interacting with Inspector in the File Browser
DAP-36678

Polling stopped in the Datameer file browser inspector which was causing unnecessary refreshing.


(tick) Bug fixed.

17

Error Dialog When Renaming a Column after Modifying a Formula in the Fx Editor
DAP-36705

Columns can now be successfully renamed.


(tick) Bug fixed.

18

A Join Sheet Doesn't Show Full Results Even after a Workbook Is Processed
DAP-36714

Join sheets are now based on the correct cluster samples.


(tick) Bug fixed.

19

Error on Renaming a Folder in File Browser: Cannot Read Property "split" of Undefined
DAP-36722

No error now given for renaming a file.


(tick) Bug fixed.

20

The Multiline Editor of a Workbook Is Empty When Users Try to Delete a Datasource
DAP-36730

The multiline editor now shows the correct formula as is no longer empty.


(tick) Bug fixed.

21

Workbooks Fail With a java.lang.IllegalArgumentException: Can Not Create a Path From an Empty String
DAP-36752

Parquet splits are now converted to FileSplit instances avoiding mixed types in GenericCombinedSplit.


(tick) Bug fixed.

22

Analyst Users Can't Change the Description of a Shared Entity
DAP-36765

If a file is shared through view and edit, "others" can change the file's description via the browser inspector.


(tick) Bug fixed.

23

Empty Export Column Mapping Is Not Handled and Leads to a Java.Lang.IndexOutOfBoundsException: Index (0) Must Be Less than Size (0)
DAP-36804

Valid export jobs now working as expected.


(tick) Bug fixed.

24

Partitioned Export Jobs Lead to Inconsistent Data in Negative Validation Cases with Hive2
DAP-36809

The expected data is now exported into Hive tables.


(tick) Bug fixed.

25

The Workbook Inspector Doesn't Adapt to a Browser's Resize Feature. Also, Clear and Add to Formula Buttons Are Hidden
DAP-36817

A browser's resize feature works correct with the workbook inspector and "Clear" and "Add to Formula" buttons are visible.


(tick) Bug fixed.

26

The In-place Filter on RTA Sheets Is Not Available after Duplicating the Workbook
DAP-36827

The in-place filter is now available on the RTA sheet after duplication.


(tick) Bug fixed.

27

Add Warn When Changing the Owner of /Users or /Users/home Folder
DAP-36833

If an admin tries to change ownership a dialog now asks for confirmation of this action.


(tick) Bug fixed.

28

It Isn't Possible in RTA to Drill When the Color-axis Value Is "None" For the Binned Date 
DAP-36869

Drilling in RTA now working as expected.

(tick) Bug fixed.

29

It Isn't Possible to Drill from None Binned Date to Date in Visual Explorer
DAP-36625

It is now possible to drill from None binned date into date.


(tick) Bug fixed.

30

Column Errors on Dependent Formula Sheets from a Self Join Sheet after Upgrading
DAP-36917

Formula sheets now have healthy columns after upgrading.


(tick) Bug fixed.

31

Upgrading from 7.1.2 to 7.2.1 Failing When Upgrading Workbooks
DAP-36983

Upgrading workbooks no longer failing when upgrading Datameer versions.


(tick) Bug fixed.

32

Can't Remove the Last Group in the Sharing Inspector
DAP-36984

The last group is now removable.


(tick) Bug fixed.

33

There Is a Missing Loading Data Dialog When Switching Sheets the First Time in an Existing Workbook
DAP-36987

Loading dialog is now displayed.


(tick) Bug fixed.

34

Java.Lang.Stackoverflowerror Exception While Processing of GROUPBYGAP
DAP-36995

GROUPBYGAP is now working as expected without errors.


(tick) Bug fixed.

35

It Isn't Possible to Edit a Partition or Exchange a Datasource with Referenced Real Time Analytics or Duplicate Sheet
DAP-37004

It is now possible to edit partitions on a datasource and RTA sheets are updated accordingly.


(tick) Bug fixed.

36

Uninstallation of Runtime Analytics Plug-in Fails
DAP-37011

Installation, uninstallation, and configuration of the plug-in works without error.


(tick) Bug fixed.

37

A Label Is Present When No Data Point Is in a Line Chart
DAP-37025

Labels are now only present where there are data points.


(tick) Bug fixed.

38

A 500 Error on Deinstallation of Plug-ins Isn't Handled By the UI
DAP-37027

Errors are now handled by the UI code and a message is shown to the user.


(tick) Bug fixed.

39

Can't Add New Formulas When the Formula Sheet Is Referenced in a Union Sheet
DAP-37034

It is now possible to add a new column to formula sheets.


(tick) Bug fixed.

40

Regression in Copy and Duplicate Functionality - Nested Dependencies Are Not Being Updated
DAP-37044

All references to subfolder artifacts are updated to point to the new copy when creating a duplicate or copy of a folder structure.


(tick) Bug fixed.

41

Fix Upgrade_db.sh Script to Return with an Error Code in an Error Case
DAP-37089

Automatic upgrade scripts now return an error code in case of failure.


(tick) Bug fixed.

42

Not Possible to Drill Into a Dataset With Visual Explorer
DAP-37119

It is now possible to drill into all applicable datasets with VE.

(tick) Bug fixed.

43

Users Without Permissions Able to Verify "Full Results" When Opening VE
DAP-37122

If the user doesn't have the rights to see the full results of a workbook, the info dialog shows up instead of the VE panel.


(tick) Bug fixed.

44

A Dependent Sheet from a Joined Sheet with Custom Named Columns Has Column Errors after Upgrade


DAP-37147

The columns are no longer in an error state after upgrading.


(tick) Bug fixed.

45

Join Columns Are Renamed after Upgrading


DAP-37178

After upgrading, the join columns now have their original names.


(tick) Bug fixed.


7.2.1 Release Notes

Improvements

1

Added Origin and Record Count Statistics to workbook-preview-service.log FileDAP-36779

Origin and record count statistics added to the workbook-preview-service.log

2

WPS Should Log the Reason Why It Doesn't Download Data from the ClusterDAP-36808

Why data was or wasn't downloaded from the cluster is available in the logs/workbook-preview-service.log

3

Enabled SDK API to Provide Currently Logged in Datameer UsersDAP-36870

Datameer's SDK API provides support to get the currently logged in user "PerformingUser" and also has all Datameer groups attached.


Bug Fixes

1

The REST API Doesn't Respect the Role Permissions Not to Download Workbook Data
DAP-32729

  • REST downloads for workbooks and imports are now restricted if the user doesn't have the correct role permission.
  • UI downloads for workbooks and imports are now restricted if the user doesn't have the correct role permission.

(tick) Bug fixed.

2

When a Partitioned Import Job Results in No Data, the Workbook Status Bar Shows "Run Workbook for Full Results" Incorrectly
DAP-34791

After a job is run resulting in no data, the workbook status bar accurately displays this information.


(tick) Bug fixed.

3

Exception given When Dragging Several Files at Once in File Browser
DAP-35345

There are now no exceptions given when a user drags multiples files in the file browser.

(tick) Bug fixed.

4

Double Clicking on a File Opens the Details Page Instead of the Wizard on a Dependency Graph
DAP-35566

The wizard for a file now opens on double click in the dependency graph.


(tick) Bug fixed.

5

The Status Bar Shows Incorrect Info When Users Apply a Workbook Filter on RTA Sheets
DAP-36209

The status bar now shows correct info when a workbook filter is applied on unprocessed RTA sheet.

(tick) Bug fixed.

6

The Drop and Create New Table Field Doesn't Work in the HiveServer2 Export Job Wizard
DAP-36230

Now users can export an existing table with a different column schema.


(tick) Bug fixed.

7

Splitting Logic Causes Excessive Info Logging for Parquet Files
DAP-36714

Excessive INFO messages relating to parquet split logic are no longer generated.


(tick) Bug fixed.

8

Not Possible to Share IFG to Public
DAP-36455

Public sharing tab is now present and the full sharing link is displayed in the inspector.


(tick) Bug fixed.

9

A Failed Migration Job That Was Rerun Doesn't Work on the Import Job Details Page
DAP-36462

  • Clicking "Rerun all failed migration jobs" now triggers job execution.
  • Clicking "Rerun migration" icon now triggers job execution.
  • The two buttons are disabled if there is no execution permission.

(tick) Bug fixed.

10

An RTA Sheet Shows an Error after Some Exploration
DAP-36496

RTA sheets now showing valid data.


(tick) Bug fixed.

11

Can't Create an Export Job From a SQL Sheet
DAP-36557

Export jobs are now working as expected.


(tick) Bug fixed.

12

Can't Create an Export Job When the Formula Sheet Contains a Dummy/Empty Column
DAP-36558

Export jobs now working as expected.


(tick) Bug fixed.

13

Fix SQL Syntax Highlighting
DAP-36562

Queries that were experiencing problems no longer do so.

(tick) Bug fixed.

14

Not Possible to Exchange Data
DAP-36587

The Exchange Data feature now works as expected in workbooks.


(tick) Bug fixed.

15

The Add Datalink with Setting 'defer Sample Generation to Workbook' into Workbook Shows Can't Get the Master Kerberos Principal for Use as Renewer
DAP-36596

A workbook preview from a HiveServer2 datalink with setting "Defer sample generation to workbook" is now available.

(tick) Bug fixed.

16

Error Given on SQL Sheet If the Multiline Editor Is Left Empty
DAP-36600

Corrected. The behavior now mirrors an fx (calculation) sheet.


(tick) Bug fixed.

17

When Setting Permissions from UI, Too Many Events Are Thrown and Lead to Duplicate Permission Changes in the HDFS
DAP-36614

Reduced the permissions changes in the HDFS to a minimum.


(tick) Bug fixed.

18

It Isn't Possible to Drill from None Binned Date to Date in Visual Explorer
DAP-36625

It is now possible to drill from None binned date into date.


(tick) Bug fixed.

19

Validate Column Names on an SQL Sheet When Renaming  Using a Backtick Characters
DAP-36657

Validate column renaming with AS statement. If the new column name contains a invalid character the correct sheet error is shown.

(tick) Bug fixed.

20

Inconsistent UX for Workbook Description Fields
DAP-36713

Description fields have been updated.


(tick) Bug fixed.

21

Adding a Column Leads to More Then One Selected Column and Possible Overriding the Previous Selected Column
DAP-36728

Now only the newly added column is selected.


(tick) Bug fixed.

22

No Space Between Cancel and save Button on Schedule Inspector
DAP-36753

Cancel and save button now have space between them.


(tick) Bug fixed.

23

With Internet Explorer 11, Parts of the Functionality are Broken on the Workbook Settings Page
DAP-36756

The top menu and the header (tabs) are now present and all sections of workbook settings work as expected.

(tick) Bug fixed.

24

EMR VPC Deployment Still Using External Connections
DAP-36772

When all components in a VPC are deployed, only internal addresses are now used.


(tick) Bug fixed.

25

 Undo Is Disabled When a User Adds a SQL Sheet into a Workbook
DAP-36786

Undo is now enabled when users add a SQL sheet into a workbook.

(tick) Bug fixed.

26

Join Sheet Column Names Get the Old Convention Naming When Upgrading to 7.2
DAP-36811

Upgrading the existing workbooks no longer modifies column naming conventions on join sheets and keeps referencing sheets intact.


(tick) Bug fixed.