Presto: Release notes for 341

Created on 9 Aug 2020  路  52Comments  路  Source: prestosql/presto

Dain Sundstrom

  • [x] all checked
  • 08-09 16:24:49 a9a51b9369 Cleanup Prometheus connector
  • 08-09 16:24:49 ba45061d37 Return TIMESTAMP WITH TIME ZONE from Prometheus connector
  • 08-10 17:46:36 91dbe5149a Return TIMESTAMP WITH TIME ZONE from Cassandra connector
  • 08-12 18:43:23 53bafb41da Fix timestamp semantics
  • 08-12 23:18:57 6053968735 Remove unused Raptor property
  • 08-13 19:05:57 6b6da3dcb3 Only request client certificate when using certificate authentication
  • 08-13 21:24:35 eec2ec4000 Add missing cast in CursorProcessorCompiler
  • 08-13 22:02:38 671f73de4c Update BigQuery timestamp parsing to new semantics
  • 08-14 13:38:27 3bb14d8679 Addressed feedback from Dain.
  • 08-14 13:38:27 7bdb74cc7c Addressed second round of review comments, mainly added xml escaping and changing cache expiration property to reflect Duration type.
  • 08-14 13:38:27 ba9b0f9485 Add salesforce authenticator.
  • 08-18 12:42:19 3180df5443 Add copyPositions and getColumns utility methods to Page

  • 08-18 12:42:19 731fc3b69b Prefer builtin Page methods that avoid Block[] copies

    David Phillips

  • [ ] all checked

  • 08-08 18:01:42 e60ef02a12 Return TIMESTAMP WITH TIME ZONE from JMX connector
  • 08-08 19:45:06 a787b5b677 Return TIMESTAMP WITH TIME ZONE from Local File connector
  • 08-09 11:55:20 8cbf5aa411 Fix documentation versions dropdown
  • 08-10 11:58:56 f8273c9b16 Remove support for Hive bucketing on timestamp
  • 08-11 07:32:20 ac585502ab Add reverse function for varbinary
  • 08-12 13:06:54 f9c6f8a126 Remove outdated comments in LdapSslSocketFactory
  • 08-13 10:36:29 f1ea630277 Correct limitation
  • 08-13 10:37:33 8775ad23d1 Add history and troubleshooting section
  • 08-13 10:38:09 d5c2711d5a Fix ordering of LIMIT in documentation
  • 08-13 10:40:14 0df358037e Update Config connection-url
  • 08-13 11:26:06 6abb38d14a Add schema and table access rules documentation
  • 08-13 14:07:42 512cd05596 Edit connection url
  • 08-13 15:21:23 21c383bf77 Update docker build scripts to use pull flag
  • 08-13 15:21:23 e3cc21349c Switch from centos jdk to zulu
  • 08-13 18:06:38 5fe83795f1 Fix Javadoc for ShortTimestampWithTimeZoneType
  • 08-17 08:05:13 217ae3bd51 Add support for Iceberg metadata delete
  • 08-17 12:18:16 c2134e8a92 Support Iceberg table and column statistics
  • 08-17 12:18:16 d484044a1b Extract class Partition from PartitionTable
  • 08-18 14:34:42 4d1ad4f97d Update pom.xml
  • 08-18 14:34:42 e931d8acc5 Upgrade Zookeeper to 3.4.14 version
  • 08-19 10:31:18 54343ff3d9 Demonstrate Spark/Iceberg and Presto/Iceberg compatibility
  • 08-19 11:25:37 b0c5ff2450 Ignore external errors in HiveMetadata::listTableColumns
  • 08-19 11:58:46 4bafe79729 Add missing time unit constants
  • 08-19 11:58:46 594ce1d220 Remove outdated JSON formats from SqlTimestamp classes
  • 08-19 15:49:29 ba49f94944 Make Iceberg smoke tests inmore consistent and less verbose
  • 08-19 22:21:15 ca80ca7eee Support the TIME type in the Iceberg connector
  • 08-20 08:53:20 4713d09fa0 Implement PrestoS3FileSystem#listFiles for direct recursive listings
  • 08-20 08:55:51 1e9650b708 Limit size of PagesIndex
  • 08-20 10:38:43 8199a6ed68 Add authentication info and reword
  • 08-20 10:40:36 39f7e08c0a Document CTAS functionality for transactional Hive tables
  • 08-21 08:06:46 f07d10e1d1 Test Spark/Iceberg compatibility for structured columns
  • 08-24 12:01:47 ce995bf0f1 Use separate page for file based system access control
  • 08-24 13:57:20 94b4074c45 Use grey theme for documentation
  • 08-26 09:31:46 026cd58bea Add Spark/Iceberg compatibility test for nested data
  • 08-27 10:54:41 d6bf73b2a7 add blank line
  • 08-27 16:13:12 975bd661af Refactor HiveMetastore API and Implementations
  • 08-28 14:28:37 1dfef5c7b1 Preserve original exception on JSON parse failure
  • 08-28 14:28:37 340f7310bc Move JSON type construction to plugin toolkit
  • 08-28 14:28:37 5c80bffb0e Remove unused method from JsonFunctions
  • 08-28 21:39:37 07b869feac Minor cleanup in ParquetWriters
  • 08-28 21:39:37 34369115ad Return int from SqlTimestamp.getPicosOfMicros()
  • 08-28 21:39:37 3d0af3bb55 Add temporal type constants and canonicalize
  • 08-28 21:39:37 42f47da1d6 Use correct type to write timestamp block
  • 08-28 21:39:37 54eea94fd7 Use microsecond timestamps in Iceberg
  • 08-28 21:39:37 834c2862b0 Inline type conversion
  • 08-28 21:39:37 a6ababbe0c Remove Iceberg hour bucketing on time type
  • 08-28 21:39:37 ce4a007a4d Remove unused toHiveType method
  • 08-28 21:39:37 ce6cb5f8e2 Fix Iceberg test name
  • 08-28 21:39:37 d52828f4c5 Improve ORC timestamp support
  • 08-28 21:39:37 e77642df42 Add import for OrcTypeKind
  • 08-29 14:25:36 4020facb50 Update testing PostgreSQL Server to latest 12.4
  • 09-01 14:55:02 4f1b0080b2 Remove unused Azure tests
  • 09-01 14:55:02 a82ca74a2d Rename S3 secret names to use uppercase
  • 09-01 14:55:02 abdc5f2432 Add GitHub workflow for Azure tests
  • 09-01 14:55:02 d279f2d9fa Only run CI on push to master
  • 09-02 10:55:30 ce921ba059 Allow custom keystore and truststore types
  • 09-02 16:34:13 5c08e41add Switch to picocli
  • 09-02 16:34:13 8e37d42b82 Remove unused startup timeout option
  • 09-02 16:34:13 a4ed820343 Convert verifier to single command

  • 09-02 16:34:13 dd2a77b653 Remove unused presto-testing-server-launcher

    Grzegorz Kokosi艅ski

  • [x] all checked

  • 08-18 02:09:51 10fa05b8a6 Allow using temporary staging path for writing sorted files
  • 08-18 02:09:51 8b5190cbb4 Document hive temporary staging directory configs
  • 08-19 03:19:34 1568436c7d Allow to configure refresh period with environment variables
  • 08-19 03:44:36 a785066fb1 Do not use presto-main in product tests
  • 08-20 05:50:16 06fea455fd Do not verify tempto convention test class names
  • 08-20 05:50:16 31357ee3f5 Introduce testng FlakyTestRetryAnalyzer
  • 08-20 05:50:16 a0ea19723b Limit the method visibility
  • 08-20 05:50:16 ae59533e92 Do not report tempto methods as missing @Test
  • 08-20 05:50:16 b1bfe9e815 Mark flaky Hive product tests
  • 08-20 05:50:16 f7fc295104 Extract presto-testng-services module
  • 08-20 13:17:51 22e4727ff3 Support overriding Object methods in tests
  • 08-20 23:53:34 966a650c84 Respect GRANT and REVOKE in CachingHiveMetastore
  • 08-20 23:53:34 fe89b9c52b Fix REVOKE in FileHiveMetastore
  • 08-23 11:59:47 1114d82b33 Mark TestHiveTransactionalTable::testReadFullAcidBucketed as flaky
  • 08-25 11:27:48 e428f603d4 Test connector when running join with empty build side
  • 08-26 02:27:20 90fdc3220a Allow retrying opening connection in Oracle
  • 08-26 02:27:20 b73e3519c3 Use DriverConnectionFactory in TestingOracleServer
  • 08-26 04:50:18 50dc92aa9e Support implementing interface in tests
  • 08-26 04:50:18 51964b02e7 Handle io.prestosql.tempto.testmarkers interfaces
  • 08-26 05:17:52 08ee3a885e Make testJoinWithEmptySides parametric
  • 08-26 12:12:51 aa6117c38b Move noJoinReordering() to AbstractTestQueryFramework
  • 08-31 05:57:01 2682f7786e Possibility to lowercase/uppercase matched user name
  • 08-31 05:57:01 2d8a2bd8e8 Configure Jackson to parse enums from lowercase strings
  • 08-31 11:08:30 b7959d41f3 Don't implement deprecated ConnectorPageSourceProvider.createPageSource
  • 08-31 12:10:04 e1f8cc14e7 Remove reorder_joins session property
  • 08-31 13:24:15 f16b97dd6b Log Presto version on startup
  • 08-31 13:26:34 2d6865be1e Put writing and building docs under Development section
  • 08-31 13:26:34 8a37910b75 Update development practices
  • 08-31 13:26:34 9a56d45cc5 Move Development section to separate file
  • 08-31 13:29:01 0bf49d9172 Do not ignore failures in LogTestDurationListener
  • 08-31 13:29:01 677bf7c6e3 Enable LogTestDurationListener by default in GHA
  • 09-02 03:31:35 c336e9a364 Handle upper case literal in where for system.jdbc.tables

  • 09-02 03:36:01 46f8f1b4fc Allow to use cluster default role in hive S3 Security Mapping

    Karol Sobczak

  • [x] all checked

  • 08-17 04:10:17 ab8e4b752f Add physicalInputDataSize to Statement/Stage stats
  • 08-17 08:11:20 aaf84274ca Relax task locking in SourcePartitionedScheduler
  • 08-17 08:11:20 d03146f035 Make BroadcastOutputBuffer#isOverutilized aggressive
  • 08-20 03:59:27 9d26aead03 Report dynamic filtering stats in QueryStats
  • 08-20 06:35:53 053029d0ef Make sure lazy dynamic filters are blocked initally
  • 08-20 06:35:53 39089fd5a6 Use forEach directly
  • 08-20 06:35:53 71d8cc6770 Improve extraction of lazy dynamic filters
  • 08-20 06:35:53 80e1bcc2e3 Use explicit field for lazy dynamic filter futures
  • 08-20 06:35:53 d01b560e82 Simplify LocalDynamicFilterConsumer
  • 08-20 06:35:53 f514f49f94 Remove "num" from dynamic filters stat fields
  • 08-20 06:35:53 fe4bf5fc61 Introduce DynamicFilterService.DynamicFilterContext
  • 08-21 03:58:46 6f824d2dcb Add memsql integration smoke tests
  • 08-24 02:35:48 1fced9e323 Short circuit lazy dynamic filters on Domain.all
  • 08-24 02:35:48 99ce43e965 Don't set future in synchronized context
  • 08-24 06:00:30 8892e05aa2 Reverse if condition
  • 08-24 06:00:30 b3ad792474 Remove unused argument
  • 08-24 13:03:09 1172c307f2 Test for removed dynamic filters explicitly
  • 08-24 13:03:09 36ba15348f Fix formatting
  • 08-24 13:03:09 e989ff7e91 Restrict method access
  • 08-24 13:04:37 18facbbdfd Fix physicalInputReadTime display in UI
  • 08-25 11:48:10 4f3b75ba41 Rename nextTaskInfoVersion to nextTaskStatusVersion
  • 08-25 11:51:23 817f25474f Propagate 'all' domain explicitly
  • 08-25 11:51:23 82cdb146a1 Use throws Exception instead of multiple exceptions
  • 08-26 03:38:54 84681181b5 Remove unused method
  • 08-26 03:38:54 e515eec1f5 Convert field to local variable
  • 08-26 05:29:02 214c08fbad Allow blocking page source until dynamic filters are ready
  • 08-26 05:29:02 7fa21f6177 Support lazy dynamic filtering at memory connector
  • 08-26 05:29:02 ec07bc2cc6 Do not enable dynamic filtering explicitly in TestMemorySmoke
  • 08-26 06:31:41 391f98bb48 Fix unauthorized error by the benchmark driver
  • 08-26 12:02:10 ede1b5f759 Deprecate ConnectorPageSourceProvider#createPageSource method
  • 08-27 01:54:09 dd1b413794 Dynamic filtering for semi-joins: planner
  • 08-27 01:55:43 80aa4354a8 Put each arg in newline
  • 08-31 08:00:15 96708b5bfd Fix race condition in unregisterDynamicFilteringQuery listener
  • 09-01 03:28:20 3cc71f4557 Fix support for mapping of dynamic filter to multiple columns
  • 09-01 03:28:20 4971ee1d1f Simplify stream
  • 09-01 03:28:20 54d49a46b7 Fix access control of methods
  • 09-01 03:28:20 598348d80b Make fields private
  • 09-01 03:28:20 e47b870bde Improve performance of obtaining same current dynamic filter

  • 09-02 06:00:07 34ded15a8e Remove unused method

    Martin Traverso

  • [x] all checked

  • 08-10 23:38:17 19811d3d58 Implement variable-precision time type
  • 08-10 23:38:17 1b9938891d Disable TIME type tests for older driver versions
  • 08-10 23:38:17 31ba61d169 Rename Timestamps to DateTimes
  • 08-11 21:21:53 bdbce6f881 Remove unused classes
  • 08-12 12:35:45 5aad0c24e1 Add pinot host mapper interface
  • 08-12 12:35:45 6819ff2f27 Add TestingPinotCluster
  • 08-12 12:35:45 8f64f2a43f Move TestUtils.toProperties to TestingKafka
  • 08-12 12:35:45 a6b20985ca Remove unused ObjectMapper from PinotPageSourceProvider
  • 08-12 12:35:45 aa1f10d3ba Add network alias for TestingKafka
  • 08-12 12:35:45 efbd683da6 Move TestingKafka to presto-testing-kafka module
  • 08-12 13:31:17 ddee904145 Deduplicate ValuesNode output symbols
  • 08-13 13:55:59 35cb998ab6 Fix functions in pinot passthrough queries
  • 08-13 19:28:53 1f3ca379c6 Add invocation count to optimizer rule stats
  • 08-13 19:28:53 f3d9bcd055 Add system table to expose optimizer rule stats
  • 08-14 09:41:28 5106a72fb3 Add support for real types
  • 08-14 09:41:28 a5d9c1e871 Add support for Integer types in pinot
  • 08-14 17:16:13 fb65d3ec59 Remove misplaced tests
  • 08-14 19:14:48 c2f21c6dc9 Fix incorrect description
  • 08-15 13:24:16 7d5c31700b Fix failure for TIME and TIMESTAMP subtraction with negative result
  • 08-15 13:24:16 f90d76519e Fix broken time type tests
  • 08-18 11:17:10 2f7c3e6b1f Fix extract timezone hour/minute for timestamp with time zone
  • 08-18 19:59:59 c77abc3d0b Remove redundant TIME tests
  • 08-19 11:12:45 093037b9c9 Respect inherited symbol mapping when reallocating symbols
  • 08-19 11:12:45 6daaf8246b Handle correlated subqueries in recursive with query
  • 08-20 15:03:36 05547eb2b4 Fix AT TIME ZONE for TIMESTAMP
  • 08-24 12:50:18 356e8bb230 Fix broker queries that use avg
  • 08-24 12:50:18 dec5d498b5 Fix pinot select count(*) queries
  • 08-24 12:50:18 fe70736fc5 Fix column mapping in pinot broker queries
  • 08-24 22:09:17 0dfd4ce26c Cleanup unused dependencies
  • 08-24 22:09:17 2dbdea2759 Add Limit to Pinot Segment Queries
  • 08-24 22:09:17 384745d782 Remove commented out code in ArrayDecoder
  • 08-24 22:09:17 3f05643504 Remove unnecessary logging
  • 08-24 22:09:17 7eb206cef4 Remove Unused Code in PinotQueryBuilder
  • 08-24 22:09:17 d0e4e04cb1 Remove PinotConfig members
  • 08-25 11:54:41 d5577c680d Add human_readable timestamp function
  • 08-31 14:09:31 d26f18cb12 Add documentation for system table optimizer_rule_stats
  • 08-31 18:46:13 88116a4a3f Support Materialized Views
  • 09-01 16:35:58 23496924b4 Fix IndexOutOfBounds non-nested-loop joins with no columns on build side
  • 09-01 16:35:58 e7199dba8e Fix IndexOutOfBounds when spilling lookup join with no build-side columns
  • 09-02 09:39:30 94746169af Implement variable precision time with time zone
  • 09-02 18:16:22 1c858f8696 Remove dedicated encoding for timestamp with precision <= 3

  • 09-02 18:16:22 7771f046f1 Replace usages of TimestampType.TIMESTAMP with TIMESTAMP_MILLIS

    Piotr Findeisen

  • [x] all checked

  • 08-17 12:26:27 38ecc954dc Avoid using shaded classes
  • 08-17 12:26:27 bdf22d9a58 Fix rawtype usage
  • 08-18 02:47:53 0a6aadc525 Add QueryAssert#returnsEmptyResult
  • 08-18 02:47:53 473cc432fe Move pushdown assertion to QueryAssert
  • 08-18 02:47:53 7722ce8ce5 Add JdbcClient method for getting ColumnMapping
  • 08-18 02:47:53 9dd690892f Make assertAggregationPushedDown more generic
  • 08-18 02:47:53 a22306bb81 Add diagnostic property to disable pushdown to connector
  • 08-18 02:47:53 bdd39aa747 Change parameter order in QueryAssert.query
  • 08-18 02:47:53 d28bc51a77 Eliminate filter above JDBC table scan
  • 08-18 02:47:53 e6c5189796 Convert if into switch
  • 08-18 02:47:53 fa59c03ee2 Provide QueryAssert in AbstractTestQueryFramework
  • 08-19 14:27:41 7944a87e90 Add a test case for parse_datetime
  • 08-20 04:11:29 5956ef7210 Show default values of benchmark driver options
  • 08-21 08:32:10 ccc934fd1b Send driver version even without matching pattern
  • 08-21 09:15:26 03b48eeb12 Retain decimal attributes
  • 08-21 09:15:26 8245658523 Inspect LogicalTypeAnnotation
  • 08-21 09:23:51 1e69a5bfed Extend aggregation pushdown over predicate
  • 08-21 09:23:51 3bd37bb435 Add simple test for aggregation and predicate pushdown
  • 08-21 14:55:35 4cd650966a Require issue when marking test as flaky
  • 08-24 04:33:24 5dc4eab88c Retry flaky tests on CI only by default
  • 08-24 07:06:20 0fc8bdc886 Mark flaky Hive product tests
  • 08-24 07:54:08 86e268d43e Fail test run when testng listener fails
  • 08-24 07:54:08 b88aa1d18d Ignore tempto generated convention tests
  • 08-24 22:43:06 477d99141c Report illegal nested directory path
  • 08-25 02:28:52 d12c018aa6 Require identifying flakiness's exception
  • 08-25 04:30:27 9751dde7c9 Mark flaky PostgreSQL test
  • 08-25 04:51:52 9541762dc2 Fix logical merge conflict
  • 08-25 13:54:39 6cb480f651 Implement JDBC ResultSet.getStatement
  • 08-25 13:57:32 2ed404b7eb Add more aggregation pushdown test cases
  • 08-26 00:08:47 31adff96ad Improve error reporting when verification fails
  • 08-26 01:54:26 193872a247 Support aggregation pushdown in MySQL connector
  • 08-26 01:54:26 5cd0e7d342 Add Pushdown section in MySQL document
  • 08-26 01:58:38 01d37540c8 Remove unused omitTimestampPrecision field
  • 08-26 02:41:29 26055ea44c Fix CONVERT_TO_VARCHAR with arrays
  • 08-26 02:41:29 3a69f4ea3f Fx bytea[] array exclusion
  • 08-26 02:41:29 8eb1522c22 Extract variable

  • 08-26 04:10:13 43dc6a7075 Fix reading with filter transactional table after minor compaction

    Praveen Krishna

  • [x] all checked

  • 08-09 05:20:06 813ac895ad Fix error when delete by a decimal primary key column.
  • 08-09 07:58:03 186fba65ae Support missingColumnsOnInsert in the Phoenix Connector.
  • 08-14 01:18:33 15e6ea67ed Include instance size for computing TimestampStatistics#getRetainedBytes
  • 08-14 01:18:33 654bb253b7 Add TimestampStatistics as a part of ColumnStatistics
  • 08-14 01:18:33 f759b9837a Write Statistics for a Timestamp column in ORC writer
  • 08-23 08:19:50 e83469c053 Add support for extra credentials in Presto BenchmarkDriver

  • 08-29 05:45:55 ff14f56c23 Allow PrestoS3FileSystem to skip DeepArchive files

    Yuya Ebihara

  • [x] all checked

  • 08-09 17:56:04 0bf4a4140c Fix release note for version 340
  • 08-10 07:03:35 512355af17 Upgrade Cassandra docker version to 2.2
  • 08-10 07:03:35 e8edc8a884 Enable testDataMappingSmokeTest for Cassandra
  • 08-10 07:03:35 ed72ce6aa2 Use constant ID for Cassandra CREATE TABLE
  • 08-10 07:03:35 fcd5c23795 Rename id column to row_id in testDataMappingSmokeTest
  • 08-11 07:25:43 1a01ba1ec3 Add orai18n for Oracle globalization support
  • 08-12 05:26:09 6c23bb1ae7 Remove redundant condition check in LongOutputStreamV2
  • 08-15 18:30:04 bc0c9dca28 Rename to OraclePoolConnectionFactory
  • 08-25 07:24:59 45dc37d4b6 Increase AWS Glue get partition max results to 1000

  • 09-01 17:31:03 ef190cc28b Fix punctuation in Prometheus documentation

    艁ukasz Osipiuk

  • [x] all checked

  • 08-10 05:57:18 b030fb42fa Various small Phoenix Connector fixes.
  • 08-10 10:02:07 1bd5a5a884 Generate reports dir automatically
  • 08-11 04:55:43 020cbed5c2 Fix serializing row type with null field values
  • 08-11 05:06:59 96df8f36be Configure Oracle UCP inactive connection timeout
  • 08-11 13:37:01 b6b1727bcf Remove product test environment startup timeout
  • 08-12 09:41:08 8ba991485c Fix legacy serialization of NULL values for ARRAY and MAP
  • 08-14 06:57:30 9bc01164ad Update Rubix version to 0.3.16
  • 08-19 02:16:46 6a32e81799 Override getCompletedBytes method in KafkaPageSink
  • 08-19 02:16:46 791352f34a Change type of errorCount in Kafka Callback
  • 08-20 01:41:05 746743999e Update hive-caching documentation for Rubix 0.3.16
  • 08-21 04:09:31 0151032d68 Mark that filesystem is owned by Rubix in Hadoop Configuration
  • 08-21 04:09:31 5ec7f78804 Postpone check if HDFS is used with caching
  • 08-21 04:09:31 680c1c73a1 Extract CachingTestUtils
  • 08-21 04:09:31 a5d79d867d Bump tempto to 181
  • 08-22 22:38:42 3b5cfc7ec5 Set scope test for testng
  • 08-24 09:55:25 c74b7536d9 Support jdbc-types-mapped-to-varchar in Oracle connector
  • 08-25 00:49:50 73ee818507 Pushdown domains with many ranges in Oracle connector
  • 08-25 00:49:50 caa67b85e1 Add Oracle pushdown tests
  • 08-25 06:42:46 123ed5103b Product tests suite definitions as code
  • 08-25 06:42:46 268fcd13f7 Debug failed environments
  • 08-25 06:42:46 30910bfb78 Remove passing of environment settings using ENV
  • 08-25 06:42:46 7b65299fb4 Remove product tests scripts
  • 08-25 06:42:46 ed8beec72d Change reports dir to contain suite, config and environment name
  • 08-26 15:00:36 1f3f481012 documentation for hive.metastore-timeout config
  • 08-27 13:57:45 a74296d696 Allow SuiteConfig to extend/configure Environment
  • 08-28 01:13:25 b59156dd01 Allow configuring all containers
  • 08-28 12:05:45 6a01d2cc8a Fix scan limit in SqlQueryManager
  • 08-29 04:17:20 04072c185f Rename SuiteConfig to EnvironmentConfig
  • 08-29 04:17:20 3e0d89c942 Add ENV based environment config
  • 08-29 04:17:20 6a1633fb04 Remove unnecessary qualifier
  • 08-29 04:17:20 c77d0eaad2 Simplify environment configuration passing
  • 08-29 04:17:20 e73645d8ba Simplify environment definitions
  • 08-30 23:10:22 5a4e498e5f Update Failsafe to 2.4.0
  • 09-01 01:37:22 24152c9c86 Add support for TopN to cost
  • 09-01 06:43:38 5324649335 Update product tests docs
  • 09-01 06:49:27 8783daa66c Update BigQuery dependencies to support HOURLY partitioning of tables
  • 09-01 06:49:27 ae6c21b56c Add BigQuery smoke test for HOUR-ly partitioned table
  • 09-01 06:49:27 eb59569d9f Redact bigquery.credentials-key config
release-notes
Source
picture martint

All 52 comments

## Prometheus Changes

* Change `timestamp` column to `TIMESTAMP WITH TIME ZONE` type.  ({issue}`4756`)

4756

dain picture dain on 10 Aug 2020 
* Add support for variable-precision `TIME` type.  ({issue}`4381`)

https://github.com/prestosql/presto/pull/4381

martint picture martint on 11 Aug 2020 
## Oracle Changes

* Add `oracle.connection-pool.inactive-timeout` config property to specify how long 
  pooled connection can be inactive before it is closed. ({issue}`4779`)

4779

losipiuk picture losipiuk on 11 Aug 2020 
## Oracle Changes

* Add support for database globalization. ({issue}`4775`)

4775

ebyhr picture ebyhr on 11 Aug 2020 
* Fix serialization of NULL values in structural types for old Presto clients ({issue}`4778`)

4778, #4780, #4781

losipiuk picture losipiuk on 12 Aug 2020 
* Fix failure when aggregation query contains duplicate expressions. ({issue}`4872`)

https://github.com/prestosql/presto/issues/4782

martint picture martint on 12 Aug 2020 
* Only request HTTPS client certificate when certificate authentication is enabled. ({issue}`4804`)

4804

dain picture dain on 14 Aug 2020 
* Fix compiler failure when querying long timestamp type. ({issue}`4824`)

4824

dain picture dain on 14 Aug 2020 
* Add support for `REAL` and `INTEGER` types. ({issue}`4725`)

https://github.com/prestosql/presto/pull/4725

martint picture martint on 14 Aug 2020 
* Add :doc:`/security/salesforce` password authentication. ({issue}`4372`)

4372

dain picture dain on 14 Aug 2020

````

General Changes

  • Change timestamp operations to match the SQL specification. The value of a TIMESTAMP type is not affected by the session time zone. ({issue}4799)
  • Fix parsing failure of timestamps due to daylight saving changes. ({issue}4799)
  • Remove the deprecated.legacy-timestamp configuration property and the legacy_timestamp session property. ({issue}4799)

Hive Connector Changes

  • Fix invalid timestamp values for nested data in Text, Avro, Sequence File, JSON and CSV formats. ({issue}4799)
  • Add Parquet and RCBinary configuration properties hive.parquet.time-zone and hive.rcfile.time-zone to adjust binary timestamp values to a specific time zone. For Hive 3.1+, this should be set to UTC. The default value is the JVM default time zone, for backwards compatibility with earlier versions of Hive. ({issue}4799)
  • Add ORC configuration property hive.orc.time-zone to set the default time zone for legacy ORC files that did not declare a time zone. ({issue}4799)
  • Replace the hive.time-zone configuration property with the format specific properties. ({issue}4799)

Cassandra Connector Changes

  • Map Cassandra TIMESTAMP type to Presto TIMESTAMP(3) WITH TIME ZONE type. ({issue}4799)

JMX Connector Changes

  • Change the type of the timestamp column for tables in the history schema to TIMESTAMP(3) WITH TIME ZONE type. ({issue}4799)

Prometheus Connector Changes

  • Change the type of the timestamp column to TIMESTAMP(3) WITH TIME ZONE type. ({issue}4799)

Local File Connector Changes

  • Change the type of the timestamp column in the http_request_log table to TIMESTAMP(3) WITH TIME ZONE type. ({issue}4799)

Raptor Connector Changes

  • Change timestamp internal storage to match Presto new semantics. Tables containing timestamp data written by a client not running in UTC will see timestamps adjusted to UTC. ({issue}4799)
  • Remove the storage.shard-day-boundary-time-zone configuration property, which was used to work around legacy timestamp semantics in Presto. ({issue}4799)

{Kafka , Redis, Kinesis} Connector Changes

  • Preserve time zone when parsing TIMESTAMP WITH TIME ZONE values. ({issue}4799)

SPI Changes

  • The TIMESTAMP type is encoded as a number of fractional seconds from 1970-01-01 00:00:00, where every day is defined to contain exactly 86400 seconds. This value is no longer adjusted to the session time zone. ({issue}4799)
  • Remove isLegacyTimestamp() from ConnectorSession. ({issue}4799)
    ````

    4799

dain picture dain on 14 Aug 2020 
* Expose physical input bytes read statistics. ({issue}`4600`}

https://github.com/prestosql/presto/pull/4600

sopel39 picture sopel39 on 17 Aug 2020 
* Improve query scalability when new nodes are added to cluster. ({issue}`4294`)

https://github.com/prestosql/presto/pull/4294

sopel39 picture sopel39 on 17 Aug 2020 
* Fix delete when applied on table having primary key of decimal type.

4683

Praveen2112 picture Praveen2112 on 18 Aug 2020 
* Fix overwriting of former value when insert is applied without specifying that column. ({issue}`4562`)

4670

Praveen2112 picture Praveen2112 on 18 Aug 2020 
* Skip stripes and row group based on Timestamp statistics for ORC files. 

Iceberg
* Skip stripes and row group based on Timestamp statistics for ORC files.

1147

Praveen2112 picture Praveen2112 on 18 Aug 2020 
* Use temporary staging directory for write operation to sorted bucketed table. ({issue}`3434`)

3434

kokosing picture kokosing on 18 Aug 2020 
* Improve performance of aggregation queries with predicates (the `WHERE` clause) by computing both filtering and
  aggregations within PostgreSQL database where possible. ({issue}`4111`)

https://github.com/prestosql/presto/issues/4111 https://github.com/prestosql/presto/pull/4565

findepi picture findepi on 18 Aug 2020 
* Fix failure when calling `EXTRACT` with `TIMEZONE_HOUR` and `TIMEZONE_MINUTE` for `TIMESTAMP WITH TIME ZONE` type. ({issue}`4867`)

4867

martint picture martint on 18 Aug 2020 
 * Allow to configure refresh period for system level access control with environment variables. ({issue}`4854`)

4854

kokosing picture kokosing on 19 Aug 2020 
* Add Iceberg connector
findepi picture findepi on 19 Aug 2020
👀1 
* Report dynamic filters stats. ({issue}`4440`)

https://github.com/prestosql/presto/pull/4440

sopel39 picture sopel39 on 20 Aug 2020 
* Invalidate cached information on `GRANT` and `REVOKE`. ({issue}`4768`)

4768

kokosing picture kokosing on 21 Aug 2020 
* Reduce latency of how fast lazy dynamic filters are collected. ({issue}`4924`)

https://github.com/prestosql/presto/pull/4924

sopel39 picture sopel39 on 24 Aug 2020 
* Fix displaying physical input read time in detailed query view. ({issue}`4962`)

https://github.com/prestosql/presto/pull/4962

sopel39 picture sopel39 on 24 Aug 2020 
## Hive Changes

* Improve performance of partition fetching from Glue. ({issue}`4938`)

4938

ebyhr picture ebyhr on 25 Aug 2020
👀1 
* Fix query deadlock for connectors that wait for dynamic filters. ({issue}`4946`)

https://github.com/prestosql/presto/pull/4946

sopel39 picture sopel39 on 25 Aug 2020 
* Add {func}`human_readable_seconds`. ({issue}`4344`)

4344

martint picture martint on 25 Aug 2020 
## JDBC Driver Changes

* Implement `ResultSet. getStatement()`. ({issue}`4957`)

4957

findepi picture findepi on 25 Aug 2020 
MySQL Connector Changes

* Improve performance of aggregation queries by computing aggregations within MySQL database.
  Currently, the following aggregate functions are eligible for pushdown:
  `count`,  `min`, `max`, `sum` and `avg`. ({issue}`4138`)

https://github.com/prestosql/presto/issues/4138 https://github.com/prestosql/presto/pull/4428

findepi picture findepi on 26 Aug 2020 
* Resilience to momentary JDBC connection authentication issues with Oracle. (:issue:`4947`)

4947

kokosing picture kokosing on 26 Aug 2020 
* Fix handling of PostgreSQL arrays when `unsupported-type-handling` is set to `CONVERT_TO_VARCHAR`. ({issue}`4981`)

https://github.com/prestosql/presto/issues/4981 https://github.com/prestosql/presto/pull/4983

findepi picture findepi on 26 Aug 2020 
* Fix query failure when reading a ORC ACID table with a filter, after the table underwent a minor compaction. ({issue}`4622`)

https://github.com/prestosql/presto/pull/4622

findepi picture findepi on 26 Aug 2020 
* Enable connectors to wait for dynamic filters before producing data on worker nodes. ({issue}`3414`)

https://github.com/prestosql/presto/pull/3414

sopel39 picture sopel39 on 26 Aug 2020
👍1 
* Allow to lowercase/uppercase matched user name in user mapping. ({issue}`4736`)

4736

kokosing picture kokosing on 31 Aug 2020 
* Skip DeepArchive objects when `skip-glacier-objects` is set. ({issue}`5002`)

5010

Praveen2112 picture Praveen2112 on 31 Aug 2020 
 * Remove deprecated `reorder_joins` session property. ({issue}`5027`)

5027

kokosing picture kokosing on 31 Aug 2020 
 * Fix issue where queries could fail if Rubix caching was used and cached data was evicted during query execution. ({issue}`3580`)

3580 #4551

losipiuk picture losipiuk on 3 Sep 2020 
 * Add possibility to force mapping of certain types to ``varchar``. This can be enabled
   by setting ``jdbc-types-mapped-to-varchar`` to comma-separated list of type names. ({issue}`4955`)

4955

losipiuk picture losipiuk on 3 Sep 2020 
 * Properly pushdown predicates for queries where number of conjuncts exceeded 1000. Previously query would fail in such case. ({issue}`4918`)

4918

losipiuk picture losipiuk on 3 Sep 2020 
 * Fix issue where ``query_max_scan_physical_bytes`` session property 
   was ignored if ``query.max-scan-physical-bytes`` config property was not defined. ({issue}`5009`)

5009

losipiuk picture losipiuk on 3 Sep 2020
🎉1 
 * Add support for HOURLY partitioning of tables. ({issue}`4968`)
 * Redact value of `bigquery.credentials-key` from logs. ({issue}`4968`)

4968

losipiuk picture losipiuk on 3 Sep 2020 
 - Allow to optionally use cluster role in s3 mapping. ({issue}`4931`)

4931

kokosing picture kokosing on 3 Sep 2020 
- Fix incorrect sampling ratio when `TABLESAMPLE` is used with percentage fraction. ({issue}`5074`)
- Correct rejecting queries using `TABLESAMPLE` with ratio being not a number. ({issue}`5074`)

5074

findepi picture findepi on 4 Sep 2020 
# JMX Connector Changes

* Change `timestamp` column type in history tables to `TIMESTAMP WITH TIME ZONE`. ({issue}`4753`)

4753

electrum picture electrum on 4 Sep 2020 
# Local File Connector Changes

* Change `timestamp` column type to `TIMESTAMP WITH TIME ZONE`. ({issue}`4752`)

4752

electrum picture electrum on 4 Sep 2020 
# Hive Connector Changes

* Remove support for bucketing on timestamp. ({issue}`4759`)

4759

electrum picture electrum on 4 Sep 2020 
# General Changes

* Add `reverse()` function for `VARBINARY`. ({issue}`4741`)

4741

electrum picture electrum on 4 Sep 2020 
# General Changes

* Fail with an explicit error rather than `OutOfMemoryError` for certain operations. ({issue}`4890`)

4890

electrum picture electrum on 4 Sep 2020 
# General Changes

* Improve error message when JSON parsing fails. ({issue}`4616`)

4616

electrum picture electrum on 4 Sep 2020 
* Fix incorrect query results when reading an ORC ACID table after the table had rows deleted underwent a minor compaction. ({issue}`4623`)

https://github.com/prestosql/presto/pull/4623

findepi picture findepi on 7 Sep 2020 
* Set user and group for new files on HDFS when writing to a table, to match table's (or partition's) user and group. ({issue}`4414`)

4414

findepi picture findepi on 7 Sep 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

fredabood picture fredabood  路  3Comments
yourmain picture yourmain  路  4Comments
electrum picture electrum  路  5Comments
theoretical-olive picture theoretical-olive  路  5Comments
BruceKellan picture BruceKellan  路  4Comments