Releases: hopshadoop/hops-gpu-management-impl-nvidia
Releases · hopshadoop/hops-gpu-management-impl-nvidia
2.8.2.7.rc0
Release notes - hops - Version 2.8.2.7
Bug
- [HOPS-132] - TestBlockReportLoadBalancing2 often time out
- [HOPS-829] - apply HDFS-5723
- [HOPS-830] - apply HDFS-5185
- [HOPS-831] - apply HDFS-6790
- [HOPS-832] - apply HDFS-6517
- [HOPS-833] - apply HDFS-6791
- [HOPS-841] - apply HDFS-6823
- [HOPS-842] - Writing small files slow down when the disk tables in the database are full
- [HOPS-843] - apply HDFS-6830
- [HOPS-845] - apply HDFS-6567
- [HOPS-846] - SSLEngine of RPC Server does not chunk the response if it is too big
- [HOPS-848] - apply HDFS-6783
- [HOPS-849] - apply HDFS-6825
- [HOPS-850] - apply HDFS-6188
- [HOPS-851] - apply HDFS-6569
- [HOPS-853] - apply HDFS-6247
- [HOPS-854] - apply HDFS-6870
- [HOPS-858] - apply HDFS-4852
- [HOPS-865] - apply HDFS-6902
- [HOPS-867] - Fixing string equality
- [HOPS-870] - apply HDFS-6972
- [HOPS-873] - apply HDFS-6831
- [HOPS-874] - apply HDFS-6979
- [HOPS-875] - apply HDFS-6862
- [HOPS-876] - apply HDFS-6898
- [HOPS-878] - apply HDFS-7005
- [HOPS-881] - Fix potential null pointer in INodeDalAdaptor, QuotaUpdateContext, INodeLock and FSNamesystem
- [HOPS-882] - Handle null values for users and groups in protobuff and fix potential null pointer exceptions
- [HOPS-885] - apply HDFS-6981
- [HOPS-886] - apply HDFS-6776
- [HOPS-887] - apply HDFS-7045
- [HOPS-888] - apply HDFS-7051
- [HOPS-889] - apply HDFS-6965
- [HOPS-890] - we need to update IntVariable to LongVariable
- [HOPS-891] - Potential NullPointers in FSNamesystem.getAdditionalDatanode
- [HOPS-893] - apply HDFS-6799
- [HOPS-895] - apply HDFS-6840
- [HOPS-896] - apply HDFS-6948
- [HOPS-897] - apply HDFS-7065
- [HOPS-898] - apply HDFS-7073
- [HOPS-899] - apply HDFS-7107
- [HOPS-900] - apply HDFS-7109
- [HOPS-901] - apply HDFS-7110
- [HOPS-902] - apply HDFS-7106
- [HOPS-903] - apply HDFS-7130
- [HOPS-904] - apply HDFS-6534
- [HOPS-907] - apply HDFS-7127
- [HOPS-911] - apply HDFS-6664
- [HOPS-912] - apply HDFS-7156
- [HOPS-913] - apply HDFS-4165
- [HOPS-914] - apply HDFS-7104
- [HOPS-915] - apply HDFS-7122
- [HOPS-916] - apply HDFS-6779
- [HOPS-917] - apply HDFS-7172
- [HOPS-918] - apply HDFS-7178
- [HOPS-919] - apply HDFS-7162
- [HOPS-920] - BPOfferService.blockReport should call blockReportCompleted in a finnaly
- [HOPS-922] - apply HDFS-6995
- [HOPS-923] - apply HDFS7-169
- [HOPS-925] - apply HDSF-7203
- [HOPS-926] - apply HDFS-7202
- [HOPS-927] - apply HDFS-7217
- [HOPS-930] - apply HDFS-6657
- [HOPS-931] - apply HDFS-6544
- [HOPS-932] - apply HDFS-7237
- [HOPS-934] - apply HDFS-7201
- [HOPS-938] - apply HDFS-7221
- [HOPS-943] - apply HDFS-7232
- [HOPS-944] - apply HDFS-7258
- [HOPS-946] - apply HDFS-6904
- [HOPS-947] - apply HDFS-6538
- [HOPS-949] - apply HDFS-7282
- [HOPS-954] - apply HDFS-7213
- [HOPS-955] - apply HDFS-7301
- [HOPS-956] - apply HDFS-7235
- [HOPS-957] - apply HDFS-7274
- [HOPS-958] - apply HDFS-7165
- [HOPS-963] - apply HDFS-7309
- [HOPS-964] - apply HDFS-7315
- [HOPS-965] - apply HDFS-6917
- [HOPS-969] - apply HDFS-7218
- [HOPS-972] - apply HDFS-7199
- [HOPS-973] - apply HDFS-7367
- [HOPS-977] - apply HDFS-7382
- [
2.8.2.6
Release notes - hops - Version 2.8.2.6
Bug
- [HOPS-369] - wrong vaule for dfs.blockreport.intervalMsec in hdfs-default.xml
- [HOPS-482] - Throttle block reports based on max no of blcok reports
- [HOPS-638] - apply HDFS-6238
- [HOPS-639] - apply HDFS-6194
- [HOPS-640] - apply HDFS-6214
- [HOPS-641] - apply HDFS-6219
- [HOPS-642] - apply HDFS-4909
- [HOPS-643] - apply HDFS-6245
- [HOPS-644] - Inode id will eventually become too big
- [HOPS-656] - apply HDFS-6178
- [HOPS-657] - apply HDFS-6275
- [HOPS-658] - apply HDFS-6217
- [HOPS-659] - apply HDFS-6276
- [HOPS-664] - apply HDFS-6218
- [HOPS-665] - apply HDFS-6288
- [HOPS-666] - apply HDFS-2882
- [HOPS-671] - apply HDFS-6337
- [HOPS-672] - apply HDFS-5381
- [HOPS-673] - apply HDFS-6340
- [HOPS-674] - Use FQDN when authenticating incoming RPCs with CN
- [HOPS-675] - DFSConfigKeys set the same value for misreplicated number of threads and number of batches
- [HOPS-678] - apply HDFS-6294
- [HOPS-679] - apply HDFS-6328
- [HOPS-681] - apply HDFS-6351
- [HOPS-682] - update hdfs-default.xml after HOPS-482
- [HOPS-683] - apply HDFS-6230
- [HOPS-684] - apply HDFS-5522
- [HOPS-685] - CRL validation does not work with new keystore schema
- [HOPS-686] - apply HDFS-6367
- [HOPS-687] - apply HDFS-6305
- [HOPS-688] - INodeUtils.getINodeIdsForBlockIds should not try to get too many blocks at once.
- [HOPS-690] - HopsExceptionHelper.isTransient should be base on the enum and not the string
- [HOPS-691] - ER_GET_TEMPORARY_ERRMSG should be transient in HopsSQLExceptionHelper
- [HOPS-692] - NameNodeResourceMonitor should check the health of the DB instead of QuotaUpdateMonitor
- [HOPS-693] - retry cache cleaner need fixing
- [HOPS-697] - dependency to com.fasterxml.jackson.core 2.2.3 is a security issue
- [HOPS-698] - apply HDFS-6370
- [HOPS-699] - apply HDFS-6326
- [HOPS-700] - apply HDFS-6287
- [HOPS-702] - apply HDFS-6362
- [HOPS-703] - apply HDFS-6402
- [HOPS-704] - apply HDFS-6345
- [HOPS-705] - apply HDFS-6250
- [HOPS-706] - apply HDFS-4913
- [HOPS-707] - apply HDFS-6325
- [HOPS-708] - apply HDFS-6397
- [HOPS-709] - apply HDFS-6421
- [HOPS-710] - apply HDFS-6396
- [HOPS-712] - apply HDFS-6423
- [HOPS-713] - apply HDFS-6227
- [HOPS-716] - apply HDFS-6461
- [HOPS-717] - apply HDFS-6356
- [HOPS-718] - apply HDFS-6404
- [HOPS-719] - apply HDFS-6472
- [HOPS-721] - apply HDFS-6424
- [HOPS-722] - apply HDFS-6268
- [HOPS-723] - apply HDFS-6369
- [HOPS-724] - apply HDFS-6497
- [HOPS-726] - apply HDFS-6257
- [HOPS-727] - apply HDFS-6399
- [HOPS-728] - apply HDFS-6315
- [HOPS-729] - apply HDFS-6379
- [HOPS-731] - apply HDFS-3493
- [HOPS-732] - apply HDFS-6330
- [HOPS-733] - apply HDFS-6529
- [HOPS-734] - apply HDFS-6539
- [HOPS-735] - apply HDFS-6530
- [HOPS-736] - apply HDFS-6559
- [HOPS-737] - apply HDFS-6480
- [HOPS-738] - Calls to concurrentBlkReports fail
- [HOPS-739] - BlockInfo.isReplicatedOnDatanode access the dabase without using the entityManager
- [HOPS-740] - Call to findBlockInfosByStorageId can overload the database
- [HOPS-741] - BlockManager.processReport should parallelize adding blocks for first report
- [HOPS-742] - FSNameSystem.addSafeBlocks can overload the database
- [HOPS-743] - Datanode removal is too slow
- [HOPS-744] - ClassCastException in BlockManager.processReport
- [HOPS-745] - EntityContext logger print too much
- [HOPS-746] - Fix client API to get number of namenodes.
- [HOPS-749] - UnderReplicatedBlockClusterj.removeAll() does not scale
- [HOPS-750] - BlockMan...
2.8.2.6.rc1
Release notes - hops - Version 2.8.2.6
Bug
- [HOPS-369] - wrong vaule for dfs.blockreport.intervalMsec in hdfs-default.xml
- [HOPS-482] - Throttle block reports based on max no of blcok reports
- [HOPS-638] - apply HDFS-6238
- [HOPS-639] - apply HDFS-6194
- [HOPS-640] - apply HDFS-6214
- [HOPS-641] - apply HDFS-6219
- [HOPS-642] - apply HDFS-4909
- [HOPS-643] - apply HDFS-6245
- [HOPS-644] - Inode id will eventually become too big
- [HOPS-656] - apply HDFS-6178
- [HOPS-657] - apply HDFS-6275
- [HOPS-658] - apply HDFS-6217
- [HOPS-659] - apply HDFS-6276
- [HOPS-664] - apply HDFS-6218
- [HOPS-665] - apply HDFS-6288
- [HOPS-666] - apply HDFS-2882
- [HOPS-671] - apply HDFS-6337
- [HOPS-672] - apply HDFS-5381
- [HOPS-673] - apply HDFS-6340
- [HOPS-674] - Use FQDN when authenticating incoming RPCs with CN
- [HOPS-675] - DFSConfigKeys set the same value for misreplicated number of threads and number of batches
- [HOPS-678] - apply HDFS-6294
- [HOPS-679] - apply HDFS-6328
- [HOPS-681] - apply HDFS-6351
- [HOPS-682] - update hdfs-default.xml after HOPS-482
- [HOPS-683] - apply HDFS-6230
- [HOPS-684] - apply HDFS-5522
- [HOPS-685] - CRL validation does not work with new keystore schema
- [HOPS-686] - apply HDFS-6367
- [HOPS-687] - apply HDFS-6305
- [HOPS-688] - INodeUtils.getINodeIdsForBlockIds should not try to get too many blocks at once.
- [HOPS-690] - HopsExceptionHelper.isTransient should be base on the enum and not the string
- [HOPS-691] - ER_GET_TEMPORARY_ERRMSG should be transient in HopsSQLExceptionHelper
- [HOPS-692] - NameNodeResourceMonitor should check the health of the DB instead of QuotaUpdateMonitor
- [HOPS-693] - retry cache cleaner need fixing
- [HOPS-697] - dependency to com.fasterxml.jackson.core 2.2.3 is a security issue
- [HOPS-698] - apply HDFS-6370
- [HOPS-699] - apply HDFS-6326
- [HOPS-700] - apply HDFS-6287
- [HOPS-702] - apply HDFS-6362
- [HOPS-703] - apply HDFS-6402
- [HOPS-704] - apply HDFS-6345
- [HOPS-705] - apply HDFS-6250
- [HOPS-706] - apply HDFS-4913
- [HOPS-707] - apply HDFS-6325
- [HOPS-708] - apply HDFS-6397
- [HOPS-709] - apply HDFS-6421
- [HOPS-710] - apply HDFS-6396
- [HOPS-712] - apply HDFS-6423
- [HOPS-713] - apply HDFS-6227
- [HOPS-716] - apply HDFS-6461
- [HOPS-717] - apply HDFS-6356
- [HOPS-718] - apply HDFS-6404
- [HOPS-719] - apply HDFS-6472
- [HOPS-721] - apply HDFS-6424
- [HOPS-722] - apply HDFS-6268
- [HOPS-723] - apply HDFS-6369
- [HOPS-724] - apply HDFS-6497
- [HOPS-726] - apply HDFS-6257
- [HOPS-727] - apply HDFS-6399
- [HOPS-728] - apply HDFS-6315
- [HOPS-729] - apply HDFS-6379
- [HOPS-731] - apply HDFS-3493
- [HOPS-732] - apply HDFS-6330
- [HOPS-733] - apply HDFS-6529
- [HOPS-734] - apply HDFS-6539
- [HOPS-735] - apply HDFS-6530
- [HOPS-736] - apply HDFS-6559
- [HOPS-737] - apply HDFS-6480
- [HOPS-738] - Calls to concurrentBlkReports fail
- [HOPS-739] - BlockInfo.isReplicatedOnDatanode access the dabase without using the entityManager
- [HOPS-740] - Call to findBlockInfosByStorageId can overload the database
- [HOPS-741] - BlockManager.processReport should parallelize adding blocks for first report
- [HOPS-742] - FSNameSystem.addSafeBlocks can overload the database
- [HOPS-743] - Datanode removal is too slow
- [HOPS-744] - ClassCastException in BlockManager.processReport
- [HOPS-745] - EntityContext logger print too much
- [HOPS-746] - Fix client API to get number of namenodes.
- [HOPS-749] - UnderReplicatedBlockClusterj.removeAll() does not scale
- [HOPS-750] - BlockMan...
2.8.2.6.rc0
Release notes - hops - Version 2.8.2.6
Bug
- [HOPS-369] - wrong vaule for dfs.blockreport.intervalMsec in hdfs-default.xml
- [HOPS-482] - Throttle block reports based on max no of blcok reports
- [HOPS-638] - apply HDFS-6238
- [HOPS-639] - apply HDFS-6194
- [HOPS-640] - apply HDFS-6214
- [HOPS-641] - apply HDFS-6219
- [HOPS-642] - apply HDFS-4909
- [HOPS-643] - apply HDFS-6245
- [HOPS-644] - Inode id will eventually become too big
- [HOPS-656] - apply HDFS-6178
- [HOPS-657] - apply HDFS-6275
- [HOPS-658] - apply HDFS-6217
- [HOPS-659] - apply HDFS-6276
- [HOPS-664] - apply HDFS-6218
- [HOPS-665] - apply HDFS-6288
- [HOPS-666] - apply HDFS-2882
- [HOPS-671] - apply HDFS-6337
- [HOPS-672] - apply HDFS-5381
- [HOPS-673] - apply HDFS-6340
- [HOPS-674] - Use FQDN when authenticating incoming RPCs with CN
- [HOPS-675] - DFSConfigKeys set the same value for misreplicated number of threads and number of batches
- [HOPS-678] - apply HDFS-6294
- [HOPS-679] - apply HDFS-6328
- [HOPS-681] - apply HDFS-6351
- [HOPS-682] - update hdfs-default.xml after HOPS-482
- [HOPS-683] - apply HDFS-6230
- [HOPS-684] - apply HDFS-5522
- [HOPS-685] - CRL validation does not work with new keystore schema
- [HOPS-686] - apply HDFS-6367
- [HOPS-687] - apply HDFS-6305
- [HOPS-688] - INodeUtils.getINodeIdsForBlockIds should not try to get too many blocks at once.
- [HOPS-690] - HopsExceptionHelper.isTransient should be base on the enum and not the string
- [HOPS-691] - ER_GET_TEMPORARY_ERRMSG should be transient in HopsSQLExceptionHelper
- [HOPS-692] - NameNodeResourceMonitor should check the health of the DB instead of QuotaUpdateMonitor
- [HOPS-693] - retry cache cleaner need fixing
- [HOPS-697] - dependency to com.fasterxml.jackson.core 2.2.3 is a security issue
- [HOPS-698] - apply HDFS-6370
- [HOPS-699] - apply HDFS-6326
- [HOPS-700] - apply HDFS-6287
- [HOPS-702] - apply HDFS-6362
- [HOPS-703] - apply HDFS-6402
- [HOPS-704] - apply HDFS-6345
- [HOPS-705] - apply HDFS-6250
- [HOPS-706] - apply HDFS-4913
- [HOPS-707] - apply HDFS-6325
- [HOPS-708] - apply HDFS-6397
- [HOPS-709] - apply HDFS-6421
- [HOPS-710] - apply HDFS-6396
- [HOPS-712] - apply HDFS-6423
- [HOPS-713] - apply HDFS-6227
- [HOPS-716] - apply HDFS-6461
- [HOPS-717] - apply HDFS-6356
- [HOPS-718] - apply HDFS-6404
- [HOPS-719] - apply HDFS-6472
- [HOPS-721] - apply HDFS-6424
- [HOPS-722] - apply HDFS-6268
- [HOPS-723] - apply HDFS-6369
- [HOPS-724] - apply HDFS-6497
- [HOPS-726] - apply HDFS-6257
- [HOPS-727] - apply HDFS-6399
- [HOPS-728] - apply HDFS-6315
- [HOPS-729] - apply HDFS-6379
- [HOPS-731] - apply HDFS-3493
- [HOPS-732] - apply HDFS-6330
- [HOPS-733] - apply HDFS-6529
- [HOPS-734] - apply HDFS-6539
- [HOPS-735] - apply HDFS-6530
- [HOPS-736] - apply HDFS-6559
- [HOPS-737] - apply HDFS-6480
- [HOPS-738] - Calls to concurrentBlkReports fail
- [HOPS-739] - BlockInfo.isReplicatedOnDatanode access the dabase without using the entityManager
- [HOPS-740] - Call to findBlockInfosByStorageId can overload the database
- [HOPS-741] - BlockManager.processReport should parallelize adding blocks for first report
- [HOPS-742] - FSNameSystem.addSafeBlocks can overload the database
- [HOPS-743] - Datanode removal is too slow
- [HOPS-744] - ClassCastException in BlockManager.processReport
- [HOPS-745] - EntityContext logger print too much
- [HOPS-746] - Fix client API to get number of namenodes.
- [HOPS-749] - UnderReplicatedBlockClusterj.removeAll() does not scale
- [HOPS-750] - BlockMan...
2.8.2.5
Release notes - hops - Version 2.8.2.5
Bug
- [HOPS-156] - Fix Hops Block Reporting System to work with multiple namenodes
- [HOPS-431] - apply HDFS-5312
- [HOPS-432] - apply HDFS-5629
- [HOPS-436] - apply HDFS-5661
- [HOPS-438] - apply HDFS-5540
- [HOPS-439] - apply HDFS-5691
- [HOPS-440] - apply HDFS-5690
- [HOPS-441] - apply HDFS-5675
- [HOPS-442] - apply HDFS-5582
- [HOPS-443] - apply HDFS-5671
- [HOPS-445] - apply HDFS-5449
- [HOPS-446] - apply HDFS-5756
- [HOPS-447] - apply HDFS-5747
- [HOPS-448] - find block by inode id return wrong result when using getIndividualBlockLock
- [HOPS-450] - apply HDFS-5579
- [HOPS-451] - apply HDFS-5762
- [HOPS-452] - apply HDFS-5766
- [HOPS-454] - apply HDFS-5704
- [HOPS-455] - apply HDFS-5777
- [HOPS-456] - apply HDFS-5800
- [HOPS-461] - HDFS web UI not working with proxy servlet
- [HOPS-463] - The transaction title for accessing client cache is set to "CONCAT". Update the name to CLIENT_CACHE.
- [HOPS-466] - apply HDFS-5728
- [HOPS-468] - Block Report fails to reset hashes of empty buckets on block report
- [HOPS-471] - apply HDFS-5842
- [HOPS-472] - apply HDFS-5843
- [HOPS-473] - apply HDFS-5790
- [HOPS-474] - apply HDFS-5856
- [HOPS-477] - Reclaim STO locks set by dead NNs
- [HOPS-480] - BockInfoDataAccess.existsOnAnyStorage is doing a full table scan
- [HOPS-481] - INodeFile.getStoragePolicyID need readcommited lock on all parent
- [HOPS-484] - BlockManager.processMisReplicatedBlocks is too slow
- [HOPS-485] - add schema update 2.8.2.4 to 2.8.2.5 to the create-tables script
- [HOPS-487] - Cgroup hierarchy creation does not always work, make improvements and more logging
- [HOPS-489] - apply HDFS-5859
- [HOPS-491] - apply HDFS-5791
- [HOPS-492] - Generate client version of ssl-server.xml for MapReduce/Hive/Tez
- [HOPS-494] - apply HDFS-5876
- [HOPS-496] - apply HDFS-5873
- [HOPS-497] - apply HDFS-5881
- [HOPS-499] - apply HDFS-5882
- [HOPS-500] - apply HDFS-5837
- [HOPS-502] - apply HDFS-4858
- [HOPS-503] - apply HDFS-5879
- [HOPS-506] - Fixing subtree operations
- [HOPS-508] - The lock level of sessions should be set back to read_commited when session are put back in the sessionPooL
- [HOPS-512] - apply HDFS-5904
- [HOPS-513] - apply HDFS-5934
- [HOPS-515] - Apply HDFS-5901
- [HOPS-517] - apply HDFS-5943
- [HOPS-518] - apply HDFS-3128
- [HOPS-519] - apply HDFS-5949
- [HOPS-520] - UsersGroups.getGroupsFromDB() not committing transaction when user is null
- [HOPS-521] - apply HDFS-5716
- [HOPS-522] - apply HDFS-5953
- [HOPS-523] - apply HDFS-5759
- [HOPS-524] - apply HDFS-5780
- [HOPS-525] - apply HDFS-5893
- [HOPS-549] - Retry mechanism on the client side for failed operations is broken
- [HOPS-550] - Unsetting the MetaEnabled for a subtree shouldn't write log entries to hdfs_metadata_log
- [HOPS-552] - Apply HDFS-6057
- [HOPS-553] - Apply HDFS-6061
- [HOPS-554] - Apply HDFS-6059
- [HOPS-555] - Apply HDFS-6067
- [HOPS-556] - Apply HDFS-6065
- [HOPS-557] - Apply HDFS-6069
- [HOPS-558] - Apply HDFS-5986
- [HOPS-559] - Apply HDFS-6071
- [HOPS-561] - Apply HDFS-6077
- [HOPS-564] - Apply HDFS-6079
- [HOPS-565] - Apply HDFS-5705
- [HOPS-566] - Apply HDFS-6096
- [HOPS-567] - Apply HDFS-6097
- [HOPS-571] - hops-metatadata-dal-impl pom pointing to both kompics and bbc1
- [HOPS-572] - Script to build native clusterj only works with ndb 7.5
- [HOPS-574] - apply HDFS-5321
- [HOPS-575] - apply HDFS-5857
- [HOPS-576] - apply HDFS-6058
- [HOPS-577] - apply HDFS-6102
- [HOPS-578] - ...
2.8.2.5.rc1
Release notes - hops - Version 2.8.2.5
Bug
- [HOPS-156] - Fix Hops Block Reporting System to work with multiple namenodes
- [HOPS-431] - apply HDFS-5312
- [HOPS-432] - apply HDFS-5629
- [HOPS-436] - apply HDFS-5661
- [HOPS-438] - apply HDFS-5540
- [HOPS-439] - apply HDFS-5691
- [HOPS-440] - apply HDFS-5690
- [HOPS-441] - apply HDFS-5675
- [HOPS-442] - apply HDFS-5582
- [HOPS-443] - apply HDFS-5671
- [HOPS-445] - apply HDFS-5449
- [HOPS-446] - apply HDFS-5756
- [HOPS-447] - apply HDFS-5747
- [HOPS-448] - find block by inode id return wrong result when using getIndividualBlockLock
- [HOPS-450] - apply HDFS-5579
- [HOPS-451] - apply HDFS-5762
- [HOPS-452] - apply HDFS-5766
- [HOPS-454] - apply HDFS-5704
- [HOPS-455] - apply HDFS-5777
- [HOPS-456] - apply HDFS-5800
- [HOPS-461] - HDFS web UI not working with proxy servlet
- [HOPS-463] - The transaction title for accessing client cache is set to "CONCAT". Update the name to CLIENT_CACHE.
- [HOPS-466] - apply HDFS-5728
- [HOPS-468] - Block Report fails to reset hashes of empty buckets on block report
- [HOPS-471] - apply HDFS-5842
- [HOPS-472] - apply HDFS-5843
- [HOPS-473] - apply HDFS-5790
- [HOPS-474] - apply HDFS-5856
- [HOPS-477] - Reclaim STO locks set by dead NNs
- [HOPS-480] - BockInfoDataAccess.existsOnAnyStorage is doing a full table scan
- [HOPS-481] - INodeFile.getStoragePolicyID need readcommited lock on all parent
- [HOPS-484] - BlockManager.processMisReplicatedBlocks is too slow
- [HOPS-485] - add schema update 2.8.2.4 to 2.8.2.5 to the create-tables script
- [HOPS-487] - Cgroup hierarchy creation does not always work, make improvements and more logging
- [HOPS-489] - apply HDFS-5859
- [HOPS-491] - apply HDFS-5791
- [HOPS-492] - Generate client version of ssl-server.xml for MapReduce/Hive/Tez
- [HOPS-494] - apply HDFS-5876
- [HOPS-496] - apply HDFS-5873
- [HOPS-497] - apply HDFS-5881
- [HOPS-499] - apply HDFS-5882
- [HOPS-500] - apply HDFS-5837
- [HOPS-502] - apply HDFS-4858
- [HOPS-503] - apply HDFS-5879
- [HOPS-506] - Fixing subtree operations
- [HOPS-508] - The lock level of sessions should be set back to read_commited when session are put back in the sessionPooL
- [HOPS-512] - apply HDFS-5904
- [HOPS-513] - apply HDFS-5934
- [HOPS-515] - Apply HDFS-5901
- [HOPS-517] - apply HDFS-5943
- [HOPS-518] - apply HDFS-3128
- [HOPS-519] - apply HDFS-5949
- [HOPS-520] - UsersGroups.getGroupsFromDB() not committing transaction when user is null
- [HOPS-521] - apply HDFS-5716
- [HOPS-522] - apply HDFS-5953
- [HOPS-523] - apply HDFS-5759
- [HOPS-524] - apply HDFS-5780
- [HOPS-525] - apply HDFS-5893
- [HOPS-549] - Retry mechanism on the client side for failed operations is broken
- [HOPS-550] - Unsetting the MetaEnabled for a subtree shouldn't write log entries to hdfs_metadata_log
- [HOPS-552] - Apply HDFS-6057
- [HOPS-553] - Apply HDFS-6061
- [HOPS-554] - Apply HDFS-6059
- [HOPS-555] - Apply HDFS-6067
- [HOPS-556] - Apply HDFS-6065
- [HOPS-557] - Apply HDFS-6069
- [HOPS-558] - Apply HDFS-5986
- [HOPS-559] - Apply HDFS-6071
- [HOPS-561] - Apply HDFS-6077
- [HOPS-564] - Apply HDFS-6079
- [HOPS-565] - Apply HDFS-5705
- [HOPS-566] - Apply HDFS-6096
- [HOPS-567] - Apply HDFS-6097
- [HOPS-571] - hops-metatadata-dal-impl pom pointing to both kompics and bbc1
- [HOPS-572] - Script to build native clusterj only works with ndb 7.5
- [HOPS-574] - apply HDFS-5321
- [HOPS-575] - apply HDFS-5857
- [HOPS-576] - apply HDFS-6058
- [HOPS-577] - apply HDFS-6102
- [HOPS-578] - ...
2.8.2.5.rc0
Release notes - hops - Version 2.8.2.5
Bug
- [HOPS-156] - Fix Hops Block Reporting System to work with multiple namenodes
- [HOPS-431] - apply HDFS-5312
- [HOPS-432] - apply HDFS-5629
- [HOPS-436] - apply HDFS-5661
- [HOPS-438] - apply HDFS-5540
- [HOPS-439] - apply HDFS-5691
- [HOPS-440] - apply HDFS-5690
- [HOPS-441] - apply HDFS-5675
- [HOPS-442] - apply HDFS-5582
- [HOPS-443] - apply HDFS-5671
- [HOPS-445] - apply HDFS-5449
- [HOPS-446] - apply HDFS-5756
- [HOPS-447] - apply HDFS-5747
- [HOPS-448] - find block by inode id return wrong result when using getIndividualBlockLock
- [HOPS-450] - apply HDFS-5579
- [HOPS-451] - apply HDFS-5762
- [HOPS-452] - apply HDFS-5766
- [HOPS-454] - apply HDFS-5704
- [HOPS-455] - apply HDFS-5777
- [HOPS-456] - apply HDFS-5800
- [HOPS-461] - HDFS web UI not working with proxy servlet
- [HOPS-463] - The transaction title for accessing client cache is set to "CONCAT". Update the name to CLIENT_CACHE.
- [HOPS-466] - apply HDFS-5728
- [HOPS-468] - Block Report fails to reset hashes of empty buckets on block report
- [HOPS-471] - apply HDFS-5842
- [HOPS-472] - apply HDFS-5843
- [HOPS-473] - apply HDFS-5790
- [HOPS-474] - apply HDFS-5856
- [HOPS-477] - Reclaim STO locks set by dead NNs
- [HOPS-480] - BockInfoDataAccess.existsOnAnyStorage is doing a full table scan
- [HOPS-481] - INodeFile.getStoragePolicyID need readcommited lock on all parent
- [HOPS-484] - BlockManager.processMisReplicatedBlocks is too slow
- [HOPS-485] - add schema update 2.8.2.4 to 2.8.2.5 to the create-tables script
- [HOPS-487] - Cgroup hierarchy creation does not always work, make improvements and more logging
- [HOPS-489] - apply HDFS-5859
- [HOPS-491] - apply HDFS-5791
- [HOPS-492] - Generate client version of ssl-server.xml for MapReduce/Hive/Tez
- [HOPS-494] - apply HDFS-5876
- [HOPS-496] - apply HDFS-5873
- [HOPS-497] - apply HDFS-5881
- [HOPS-499] - apply HDFS-5882
- [HOPS-500] - apply HDFS-5837
- [HOPS-502] - apply HDFS-4858
- [HOPS-503] - apply HDFS-5879
- [HOPS-506] - Fixing subtree operations
- [HOPS-508] - The lock level of sessions should be set back to read_commited when session are put back in the sessionPooL
- [HOPS-512] - apply HDFS-5904
- [HOPS-513] - apply HDFS-5934
- [HOPS-515] - Apply HDFS-5901
- [HOPS-517] - apply HDFS-5943
- [HOPS-518] - apply HDFS-3128
- [HOPS-519] - apply HDFS-5949
- [HOPS-520] - UsersGroups.getGroupsFromDB() not committing transaction when user is null
- [HOPS-521] - apply HDFS-5716
- [HOPS-522] - apply HDFS-5953
- [HOPS-523] - apply HDFS-5759
- [HOPS-524] - apply HDFS-5780
- [HOPS-525] - apply HDFS-5893
- [HOPS-549] - Retry mechanism on the client side for failed operations is broken
- [HOPS-550] - Unsetting the MetaEnabled for a subtree shouldn't write log entries to hdfs_metadata_log
- [HOPS-552] - Apply HDFS-6057
- [HOPS-553] - Apply HDFS-6061
- [HOPS-554] - Apply HDFS-6059
- [HOPS-555] - Apply HDFS-6067
- [HOPS-556] - Apply HDFS-6065
- [HOPS-557] - Apply HDFS-6069
- [HOPS-558] - Apply HDFS-5986
- [HOPS-559] - Apply HDFS-6071
- [HOPS-561] - Apply HDFS-6077
- [HOPS-564] - Apply HDFS-6079
- [HOPS-565] - Apply HDFS-5705
- [HOPS-566] - Apply HDFS-6096
- [HOPS-567] - Apply HDFS-6097
- [HOPS-571] - hops-metatadata-dal-impl pom pointing to both kompics and bbc1
- [HOPS-572] - Script to build native clusterj only works with ndb 7.5
- [HOPS-574] - apply HDFS-5321
- [HOPS-575] - apply HDFS-5857
- [HOPS-576] - apply HDFS-6058
- [HOPS-577] - apply HDFS-6102
- [HOPS-578] - ...
2.8.2.4
Release notes - hops - Version 2.8.2.4
Bug
- [HOPS-77] - Fix TestDataDirs test
- [HOPS-113] - Add support for /.reserved/.inodes/<inodeId> directory
- [HOPS-154] - Allow superusers to submit Yarn applications wtih SSL enabled
- [HOPS-155] - Store small files on the datanodes if the database disk tables are full.
- [HOPS-160] - Do not swallow FileNotFound Exception in NamenodeSelector
- [HOPS-161] - TestSmallFilesCreation.java takes ~30 min on slow machines.
- [HOPS-162] - RM and NM should materialize certificates in {RM,NM}_certLoc/UUID/
- [HOPS-168] - fix table creation script.
- [HOPS-170] - Slow deletionof very large directories
- [HOPS-172] - HOPS-86 removed the datanode upgrade system, we need to fix it
- [HOPS-174] - apply HDFS-4639
- [HOPS-175] - apply HDFS-4693
- [HOPS-176] - apply HDFS-4737
- [HOPS-183] - Old keystore password for Client is cached into the system
- [HOPS-184] - apply HDFS-4209
- [HOPS-185] - Containers requiring GPUs should not be able to reserve resources on NodeManagers with no GPUs.
- [HOPS-186] - CryptoMaterial buffers should be available for re-reading
- [HOPS-188] - apply HDFS-4334
- [HOPS-189] - apply HDFS-4296
- [HOPS-190] - apply HDFS-4339
- [HOPS-191] - apply HDFS-4346
- [HOPS-192] - apply HDFS-4243
- [HOPS-193] - apply HDFS-4340
- [HOPS-194] - apply HDFS-4502
- [HOPS-195] - apply HDFS-4745
- [HOPS-198] - apply HDFS-4768
- [HOPS-199] - apply HDFS-4305
- [HOPS-200] - apply HDFS-4434
- [HOPS-201] - Spark incompatible with our new constructor for ApplicationInitializationContext
- [HOPS-202] - update README
- [HOPS-203] - apply HDFS-4785
- [HOPS-204] - apply HDFS-4784
- [HOPS-206] - apply HDFS-4799
- [HOPS-207] - apply HDFS-4751
- [HOPS-208] - apply HDFS-4533
- [HOPS-209] - apply HDFS-4765
- [HOPS-210] - apply HDFS-3180
- [HOPS-215] - apply HDFS-4830
- [HOPS-216] - apply HDFS-4824
- [HOPS-217] - apply HDFS-3875
- [HOPS-218] - apply HDFS-4807
- [HOPS-219] - apply HDFS-4714
- [HOPS-220] - apply HDFS-4740
- [HOPS-221] - apply HDFS-4705
- [HOPS-222] - apply HDFS-4825
- [HOPS-223] - apply HDFS-4780
- [HOPS-224] - apply HDFS-4827
- [HOPS-225] - apply HDFS-4865
- [HOPS-228] - apply HDFS-4261
- [HOPS-229] - apply HDFS-4840
- [HOPS-230] - apply HDFS-4862
- [HOPS-231] - apply HDFS-4832
- [HOPS-232] - apply HDFS-4752
- [HOPS-233] - apply HDFS-4878
- [HOPS-234] - partly apply HDFS-4873
- [HOPS-235] - apply HDFS-3009
- [HOPS-236] - apply HDFS-3934
- [HOPS-237] - apply HDFS-4910
- [HOPS-238] - apply HDFS-4626
- [HOPS-239] - apply HDFS-4818
- [HOPS-240] - apply HDFS-4906
- [HOPS-242] - apply HDFS-4917
- [HOPS-244] - apply HDFS-4883
- [HOPS-247] - apply HDFS-4205
- [HOPS-248] - apply HDFS-4944
- [HOPS-249] - apply HDFS-4888
- [HOPS-250] - apply HDFS-4943
- [HOPS-253] - apply HDFS-4951
- [HOPS-254] - apply HDFS-4887
- [HOPS-255] - apply HDFS-4969
- [HOPS-257] - apply HDFS-4980
- [HOPS-264] - Add dependencies license document
- [HOPS-265] - Apply HDFS-4657
- [HOPS-266] - apply HDFS-4999
- [HOPS-267] - apply HDFS-4687
- [HOPS-268] - apply HDFS-4998
- [HOPS-276] - apply HDFS-5016
- [HOPS-278] - apply HDFS-5035
- [HOPS-282] - apply HDFS-5043
- [HOPS-284] - apply HDFS-5028
- [HOPS-288] - apply HDFS-5047
- [HOPS-289] - apply HDFS-5083
- [HOPS-290] - apply HDFS-49...
2.8.2.4.rc0
Release notes - hops - Version 2.8.2.4
Bug
- [HOPS-77] - Fix TestDataDirs test
- [HOPS-113] - Add support for /.reserved/.inodes/<inodeId> directory
- [HOPS-154] - Allow superusers to submit Yarn applications wtih SSL enabled
- [HOPS-155] - Store small files on the datanodes if the database disk tables are full.
- [HOPS-160] - Do not swallow FileNotFound Exception in NamenodeSelector
- [HOPS-161] - TestSmallFilesCreation.java takes ~30 min on slow machines.
- [HOPS-162] - RM and NM should materialize certificates in {RM,NM}_certLoc/UUID/
- [HOPS-168] - fix table creation script.
- [HOPS-170] - Slow deletionof very large directories
- [HOPS-172] - HOPS-86 removed the datanode upgrade system, we need to fix it
- [HOPS-174] - apply HDFS-4639
- [HOPS-175] - apply HDFS-4693
- [HOPS-176] - apply HDFS-4737
- [HOPS-183] - Old keystore password for Client is cached into the system
- [HOPS-184] - apply HDFS-4209
- [HOPS-185] - Containers requiring GPUs should not be able to reserve resources on NodeManagers with no GPUs.
- [HOPS-186] - CryptoMaterial buffers should be available for re-reading
- [HOPS-188] - apply HDFS-4334
- [HOPS-189] - apply HDFS-4296
- [HOPS-190] - apply HDFS-4339
- [HOPS-191] - apply HDFS-4346
- [HOPS-192] - apply HDFS-4243
- [HOPS-193] - apply HDFS-4340
- [HOPS-194] - apply HDFS-4502
- [HOPS-195] - apply HDFS-4745
- [HOPS-198] - apply HDFS-4768
- [HOPS-199] - apply HDFS-4305
- [HOPS-200] - apply HDFS-4434
- [HOPS-201] - Spark incompatible with our new constructor for ApplicationInitializationContext
- [HOPS-202] - update README
- [HOPS-203] - apply HDFS-4785
- [HOPS-204] - apply HDFS-4784
- [HOPS-206] - apply HDFS-4799
- [HOPS-207] - apply HDFS-4751
- [HOPS-208] - apply HDFS-4533
- [HOPS-209] - apply HDFS-4765
- [HOPS-210] - apply HDFS-3180
- [HOPS-215] - apply HDFS-4830
- [HOPS-216] - apply HDFS-4824
- [HOPS-217] - apply HDFS-3875
- [HOPS-218] - apply HDFS-4807
- [HOPS-219] - apply HDFS-4714
- [HOPS-220] - apply HDFS-4740
- [HOPS-221] - apply HDFS-4705
- [HOPS-222] - apply HDFS-4825
- [HOPS-223] - apply HDFS-4780
- [HOPS-224] - apply HDFS-4827
- [HOPS-225] - apply HDFS-4865
- [HOPS-228] - apply HDFS-4261
- [HOPS-229] - apply HDFS-4840
- [HOPS-230] - apply HDFS-4862
- [HOPS-231] - apply HDFS-4832
- [HOPS-232] - apply HDFS-4752
- [HOPS-233] - apply HDFS-4878
- [HOPS-234] - partly apply HDFS-4873
- [HOPS-235] - apply HDFS-3009
- [HOPS-236] - apply HDFS-3934
- [HOPS-237] - apply HDFS-4910
- [HOPS-238] - apply HDFS-4626
- [HOPS-239] - apply HDFS-4818
- [HOPS-240] - apply HDFS-4906
- [HOPS-242] - apply HDFS-4917
- [HOPS-244] - apply HDFS-4883
- [HOPS-247] - apply HDFS-4205
- [HOPS-248] - apply HDFS-4944
- [HOPS-249] - apply HDFS-4888
- [HOPS-250] - apply HDFS-4943
- [HOPS-253] - apply HDFS-4951
- [HOPS-254] - apply HDFS-4887
- [HOPS-255] - apply HDFS-4969
- [HOPS-257] - apply HDFS-4980
- [HOPS-264] - Add dependencies license document
- [HOPS-265] - Apply HDFS-4657
- [HOPS-266] - apply HDFS-4999
- [HOPS-267] - apply HDFS-4687
- [HOPS-268] - apply HDFS-4998
- [HOPS-276] - apply HDFS-5016
- [HOPS-278] - apply HDFS-5035
- [HOPS-282] - apply HDFS-5043
- [HOPS-284] - apply HDFS-5028
- [HOPS-288] - apply HDFS-5047
- [HOPS-289] - apply HDFS-5083
- [HOPS-290] - apply HDFS-49...
2.8.2.3
Release notes - hops - Version 2.8.2.3
Bug
- [HOPS-109] - Quota management of Small Files
- [HOPS-136] - Container logging does handle lost containers
- [HOPS-137] - Quota is not recorded appropriately for small files which result in negative quota when deleting files/directories
- [HOPS-140] - garbage container logs and checkpoint remaining int the database
- [HOPS-143] - Quota multiplicator fixed period does not behave according to specification
- [HOPS-150] - Test code was commited by accident and block from having more than one gpu
- [HOPS-152] - app get stuck in NEW_SAVING when user name too long
- [HOPS-155] - Store small files on the datanodes if the database disk tables are full.
- [HOPS-157] - Nullpointer and Index out of bound since HOPS-152
- [HOPS-170] - Slow deletionof very large directories
- [HOPS-185] - Containers requiring GPUs should not be able to reserve resources on NodeManagers with no GPUs.
- [HOPS-322] - interferences between TransactionalRequestHandler and LightWeightRequestHandler
- [HOPS-337] - replication Index stuck in UnderReplicatedBlocks
- [HOPS-365] - NullPointerException when trying to role back transaction
- [HOPS-366] - Datanode not doing block report after exception
- [HOPS-368] - NullPointerException when trying to invalidate blocks on dead datanode
- [HOPS-396] - Maximum GPU allocation gets set to 0
New Feature
- [HOPS-141] - Monitor and control CertificateLocalizationService via JMX
Improvement
- [HOPS-131] - Base price should be different for GPU resource and for General resources
- [HOPS-133] - Remove deploy-server.sh from hops-metadata-dal-impl-ndb and hops-gpu-management-impl-nvidia
- [HOPS-138] - Increase detail of log output for processed block report
- [HOPS-139] - Add another method for ContentSummary to return the results directly from inodes_attributes in quote enabled directories
- [HOPS-144] - Disabled uber pricing
- [HOPS-149] - Add app IDs in project daily cost
- [HOPS-151] - App's GPU usage in Yarn UI
- [HOPS-158] - Refactor HopsSSLSocketFactory and add check for Environment Variable set with crypto material
- [HOPS-164] - fix hops schema updates for Flyway
- [HOPS-166] - change flyway storage engine from innodb to ndb
- [HOPS-350] - Update ClusterJ and libndbclient to 7.5.10