-
Notifications
You must be signed in to change notification settings - Fork 27
/
CHANGES.txt
900 lines (793 loc) · 33.1 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
Datafari Changes Notes
Introduction
-------------
Datafari is an open source enterprise search solution. It is the perfect product for anyone who needs to search and analyze its corporate data and documents, both within the content and the metadata.
Available as community (open source) and enterprise (proprietary) edition, Datafari is different from the competition :
- Its open source license is not aggressive, as it uses the Apache v2 license: you are free to do whatever you want with it, you just need to mention that you are using it.
- It combines three renowned Apache projects, namely Cassandra, Solr and ManifoldCF, which gives Datafari a long term vision.
See https://wiki.datafari.com for more information.
================== 6.0 ==================
March 7th, 2024
* Version of major components :
- Solr 9.5
- ManifoldCF 2.26
- Tomcat 9.0.81
- Cassandra 4.1.3
- PostgreSQL 15.4
- Zookeeper 3.9.1
- Tika Server 2.9.1
- DatafariUI 1.4
- AdminUI 1.0
#213 Improve wildcards management
#673 Store entites in dedicated fields
#693 Change the domain archive.apache.org for dependencies download
#740 web connector - Index by default meta description and meta keywords
#787 Extend simplified job with 2 filtering possibilities
#792 Don't transfer the current email admin password
#881 Transfo Connector - Regex associated to Metadata
#895 Transfo Connector - Add options to the regex connector
#896 Admin - remove cat jdk warning message in install script
#899 Improve Java check at startup of Datafari
#900 Web connector - Follow redirection when receiving code 301
#901 DatafariUI - Create yellow page widget
#902 Regex connector - add possibility to have other types of values in the destination field
#903 DatafariUI - Create quick links widget
#907 Datafari must support Debian 12
#911 Enable https for the logstash output to Solr
#921 Change of constructor SolrZkClient between Solr 9.1 and 9.4 needs modification of Datafari code
#922 Remove simplified Person Entity Extraction
#924 Add processing logs to connectors
#925 Changes needed for aggregator mode
#928 Solr ingester connector evolution for Solr 9
#934 Improve default exact match results
#946 Datafari API - user specific search history
#951 Create new Solr configuration for annotators collections
#953 Develop an atomic service for Solr update
#861 Upgrade Solr from 8.11.2 to 9
#875 Update dependencies required into control file for Debian
#935 Update Solr to version 9.4.1
#941 Update Cassandra from 4.0.9 to 4.1.3
#947 Update Logstash to 8.12.1 version
#948 Update Solr to version 9.5
#949 Update Cassandra Java driver to 4.17
#954 Update Tika to version 2.9.1
#955 Update MCF to 2.26 version
#956 Update PostgreSQL to 15.4 version
#957 Update Zookeeper to 3.9.1 version
#958 Update DatafariUI to 1.4 version
#959 Update AdminUI to 1.0 version
#647 Broken Statistics and user sessions dashboards when using DatafariUI
#744 DatafariUI - hierarchical facet displays duplicates html files
#897 DatafariUI - Entity Autocomplete does not work with v2 Datafari search API
#898 DatafariUI - Entity Autocomplete should work into v2 API
#923 Web connector : issue with 301 redirect
#926 Admin - Uppercase chars not handled for non imported users
#927 Issue regarding the indexation of dates for some types of files
#929 Error when indexing with Spacy transformation connector : Form with too many parts
#932 Old UI URL provided in the console during installation
#936 Postgresql logs have moved
#937 Issue with scripts for automatic Tika server creation for OCR
#950 Problem with CQLSH with Cassandra 4.1
#963 CVE-2021-26291 Update Postgresql JDBC driver
================== 5.5 ==================
May 16th, 2023
* Version of major components :
- Solr 8.11.2
- ManifoldCF 2.24
- Tomcat 9.0.56
- Cassandra 4.0.1
- PostgreSQL 12.4
- Zookeeper 3.6.2
- Tika Server 2.7.0
- Zeppelin 0.10.1
- DatafariUI 1.3
#846 DatafariUI - update to search REST API v2
#852 DatafariUI - Exception not handled for licence issue into DatafariUI (EE)
#866 DatafariUI - Adapt the Export Results to the new menu
#870 DatafariUI - Aggregator facet does not seem to work
#894 DatafariUI - UI config not saved sometimes
#880 DatafariUI - hierarchical facet incorrect behavior
#882 DatafariUI - facets not saved when checking the dedicated checkbox
#883 DatafariUI - search alerts not saving the query
#886 DatafariUI - Modifications to theme.json are ignored
#888 DatafariUI - Warning licence messages not properly work
#889 DatafariUI - Propose an SSO option
#871 Improve simple entity extraction by experimenting native Tika feature
#872 MCF - add gif to the OCR simplified job default inclusion filter
#885 Propose SSD conf in install script for PostgreSQL
#887 Redirect to asked resource on successful authentication
#892 CVE-2022-42889 ???Text4Shell??? vulnerability
#884 Provide a protected endpoint that performs a simple redirect
#893 Keep persistence after a restart of Docker container for CE
#864 Factory reset not present into Datafari 5.3 release
================== 5.4 ==================
March 10th, 2023
* Version of major components :
- Solr 8.11.2
- ManifoldCF 2.24
- Tomcat 9.0.56
- Cassandra 4.0.1
- PostgreSQL 12.4
- Zookeeper 3.6.2
- Tika Server 2.7.0
- Zeppelin 0.10.1
#638 Check at monoserver install phase that server name is correct
#643 Adapt backend to transfer errors from datafaris
#718 Check and apply Solr schema custom fields at first startup
#841 Synchronize Zookeeper libs to the correct version
#858 Keep only a single date for Solr date fields
#859 Add missing suggester for Authors
#877 Map Tika fields into Datafari update processor
#786 Datafari API - update search endpoint to generate stats
#843 API - Review and update Users history functionnality
#820 DatafariUI - malformed uiconfig should not be silently discarded
#823 DatafariUI - synchronise facets and autocomplete when applicable
#828 DatafariUI - saved searches not using all the facets
#845 DatafariUI - Implement retry/reconnection mechanism
#855 DatafariUI - default facets config and advanced search config
#860 DatafariUI - wrong field associated to last modified facet
#867 DatafariUI - create the aggregator functionality
#862 Autocomplete for entity extraction not working
#525 [DATAFARI-533] Ajaxfrancelabs - File size widget not working with IE
#879 Decision - Hierarchical facet - check/uncheck behavior
#874 Modify export results behavior
#681 Admin link to the search UI should point to DatafariUI
#837 MCF - Default jobs should have delta mode enabled
#838 DB simplified connector - move the optional access token field below the security checkbox
#839 DB simplified connector - add mariadb in the dropdown of possible DBs available
#842 Add JDBC drivers by default to Datafari
#832 Admin - propose more options for simplified jobs creation
#854 Propose a "duplicate detection" functionality
#857 Admin tool to create a Tika Server instance
#819 Error message during dpkg install
#844 Check syntax of queries in simplified database UI
#865 Error on Solr query : Can't facet on a PointField without docValues
#868 404 error for /api URL into Solr admin UI
#869 Update the data models documentation
#733 Update OCR documentation
#876 Aggregator works only for external Datafari sites and not for local one
================== 5.3 ==================
Sept. 22th, 2022
* Version of major components :
- Solr 8.11.2
- ManifoldCF 2.23
- Tomcat 9.0.56
- Cassandra 4.0.1
- PostgreSQL 12.4
- Zookeeper 3.6.2
- Tika Server 2.4.0
- Zeppelin 0.10.1
- DatafariUI 1.1
#824 DatafariUI - suggestions with whitespace not properly handled
#847 Suggestions for entities do not respect exact search
#159 [DATAFARI-160] Query facet display for value with 0 document
#833 Datafari does not work on Ubuntu 22
#849 Datafari does not work with Python 3
#850 Upgrade MCF to 2.23 version
#486 Update wiki docs to reflect usage of Zeppelin
================== 5.2 ==================
July 5th, 2022
* Version of major components :
- Solr 8.11.1
- ManifoldCF 2.22.1
- Tomcat 9.0.56
- Cassandra 4.0.1
- PostgreSQL 12.4
- Zookeeper 3.6.2
- Tika Server 2.4.0
- Zeppelin 0.10.1
- DatafariUI 1.1
### Issues list done
#416 [DATAFARI-423] Incorrect type for Size facet
#440 [DATAFARI-447] Display full facet label text as alt text when truncated
#535 [DATAFARI-543] Ajaxfrancelabs - opening files with FILE API
#632 Save and load language preference of a user
#698 Ajaxfrancelabs - autocomplete at welcome page different from results page
#307 [DATAFARI-311] Add warnings for users validating changes in ZK
#691 Admin UI - Grey out dashboard menu items when opendistro offline
#812 Admin - Harmonise the admin users with the same login
#727 Add processing logs in web connector
#783 Store users past queries in a cassandra collection
#811 Temporary partition for components
#611 DatafariUI - Add information about logo preferred format in the README
#633 Add a warning when title for saving a query already exists
#666 datafariUI - use the arrow to scroll in the autocomplete list
#779 DatafariUI - create an aggregator widget
#729 DatafarifUI - Some terms don't seem to have autocomplete
#730 DatafariUI - for some terms searched, autocomplete displayed AFTER search is done
#739 DatafariUI - store user preference about datafariUI display
#742 DatafariUI - refactor main page using react
#746 DatafariUI - update readme about config file
#785 DatafariUI - propose a bar chart facet
#789 DatafariUI - enable possibility to have facets both on the left and on the right
#806 DatafariUI - div width changes depending on query
#807 DatafariUI - display date facet with customfacetdate only
#808 DatafariUI - cannot overwrite saved query
#809 DatafariUI - update json configuration for sendToSolr
#822 DatafariUI - truncate facet values text if too long
#825 DatafariUI - rename facet label
#827 DatafariUI - avoid auto refresh every 60secs
#606 Datafari API - Create an API endpoint to access aggregator related information
#614 Datafari - API must store user actions
#737 Datafari API - Modify document URL to embed tracking before sending response
#778 Create an endpoint for the aggregator functionality
#781 Datafari API - Update the search endpoint to handle user context
#782 Datafari API - create endpoint to retrieve user past queries
#821 DatafariAPI issue with undeclared or unauthorized handlers
#728 Improve OOM management of MCF stuffer thread
#810 Catch Runtime exceptions in repository connectors
#819 Error message during dpkg install
#826 Improve error description of simplified jobs
#710 Adapt the file connector to jcifs-ng 2.1.6+
#815 Update Tika Server to v2.4.0
#818 Update MCF to v2.22
#831 Update Logstash OSS to v8.2.0
#834 MCF - Simplified DB job
#482 [DATAFARI-489] Add a permanent text widget to opendistro
#488 [DATAFARI-495] Admin - Graphically change ELK admin user password
#489 [DATAFARI-496] Install script - ask for elk admin password
#649 Fully transition statistics dashboards to rely only on Cassandra storage
#750 Investigate migrating away from opendistro - migration to Apache Zeppelin
#835 Protect Zeppelin notebooks with apache2 auth
================== 5.1 ==================
Feb. 12nd, 2022
* Version of major components :
- Solr 8.11.1
- ManifoldCF 2.21
- Tomcat 9.0.56
- Cassandra 4.0.1
- PostgreSQL 12.4
- Zookeeper 3.6.2
- Tika Server 1.18
- OpenDistro 1.9.0
- ElasticSearch 7.8.0
- Kibana 7.8.0
- LogStash 7.8.0
### Issues list done
#111 [DATAFARI-112] Hierarchical facet is not showing correctly for file shares
#130 [DATAFARI-131] Autocomplete not working
#212 [DATAFARI-213] Understand wildcards as prefix of search terms
#250 [DATAFARI-251] Improve ManifoldCF access security
#275 [DATAFARI-276] Create and feed a "title_metadata" search field
#391 [DATAFARI-397] Remove the hamburger in the mobile UI
#395 [DATAFARI-401] && statement not properly interpreted in the datafari search landing page
#423 [DATAFARI-430] Multiple language support for privacy policy page
#431 [DATAFARI-438] Change the creation of the FileShare configset into ZK
#444 [DATAFARI-451] In MCF simple history, report documents that are excluded from the fetching
#450 [DATAFARI-457] Build links to the preview, must open in a new tab
#452 [DATAFARI-459] migrate from embedded Tika into MCF to tika server
#465 [DATAFARI-472] Update documentation to add a new language for text analysers and/or UI display
#466 [DATAFARI-473] Incomplete language doc for v4.4
#467 [DATAFARI-474] Handle non alphanumeric characters for the graphical change of MCF admin account
#476 [DATAFARI-483] Document our usage of an Apache Proxy
#477 [DATAFARI-484] TLS Doc - Update for V5
#478 [DATAFARI-485] Update doc on requirements for Python
#480 [DATAFARI-487] Update doc about MCF restore functionnality
#484 [DATAFARI-491] Update doc about ELK open distro
#491 [DATAFARI-498] Create a transfo connector to clean up characters
#502 [DATAFARI-509] Doc - update wiki about v5 requirements : python, dependencies, java
#503 [DATAFARI-510] Admin UI - Change label backup and restore MCF
#510 [DATAFARI-517] In preview, make the search bar functionnal
#511 [DATAFARI-518] Add spellcheck capabilities to DatafariUI
#513 [DATAFARI-520] Search UI - truncated results snippet
#516 [DATAFARI-524] Connectors - Add a Confluence connector
#517 [DATAFARI-525] Connectors - Add a Jira connector
#518 [DATAFARI-526] New facet - Tag Cloud
#519 [DATAFARI-527] Opendistro - no index created error when first connecting
#524 [DATAFARI-532] DatafariUI - automatically search best guess if no results
#541 [DATAFARI-549] Connectors - Add wmv to the default emptier filter
#542 [DATAFARI-550] MCF - enable the file output connector
#544 [DATAFARI-552] DatafariUI - Make the help page i18n
#545 [DATAFARI-553] DatafariUI - In preview page, highlight term in widget
#550 [DATAFARI-558] DatafariUI - Change 3 dots menu behavior in search preview
#552 [DATAFARI-560] DatafariUI - propose open folder button in results list
#553 [DATAFARI-561] DatafariUI - show full url in tooltip if truncated
#556 [DATAFARI-564] DatafarUI - make search bar active in preview mode
#557 [DATAFARI-565] DatafariUI - Display proper number of results
#560 [DATAFARI-568] DatafariUI - character encoding issues in favorites
#561 [DATAFARI-569] DatafariUI - take into account the activation/deactivation of favorites
#565 [DATAFARI-573] DatafariUI - target new for favorites
#567 [DATAFARI-575] DatafariUI - use mail API to fill in the template emails for users
#569 [DATAFARI-577] DatafariUI - add privacy policy page
#571 [DATAFARI-579] DatafariUI - link to the admin page from search page
#575 [DATAFARI-583] DatafariUI - Date facets numbers are weird
#574 [DATAFARI-582] DatafariUI - make it responsive
#578 [DATAFARI-586] DatafariUI - typo in the autocomplete in english
#579 [DATAFARI-587] DatafariUI - 404 error when opening previews
#580 [DATAFARI-588] DatafariUI - cannot click on facets when loading a saved search
#581 [DATAFARI-589] DatafariUI - wrong font used in facet
#591 DatafariUI - review and comment code
#592 DatafariUI - Change Date facet title
#593 DatafariUI - display other search message in case of 0 results
#594 DatafariUI - Make the privacy Policy i18n
#595 DatafariUI - preview highlighted terms
#601 DatafariUI - Created date sorting
#604 DatafariUI - Update privacy settings page
#607 DatafariUI - licence limit warning
#608 DatafariUI - do not display "No results" becase redundant
#609 DatafariUI - Clear filter on facets causes exception
#613 DatafariUI - documentation about i18n in confluence requires a concrete exemple
#615 UI - Hierarchical facets not working with ajaxfrancelabs
#616 Manage specific solr output error
#617 Admin - Make it clear that the security checkbox is useless for simplifed connectors
#619 DatafariUI - don't display warning before licence is over
#620 White font over white background
#621 Cannot remove filters in the text next to results
#622 Bug popup title is incorrect
#623 content when sending bugs not taken into account
#624 Search from preview cancels target = new
#625 "Don't find doc" popup title is incorrect
#626 Error when saving query
#627 Error when using alerts
#628 logout menu does not work
#629 Deactivate browser based autocomplete for search
#630 Error when doing empty advanced search
#631 Change default html meta tags
#635 Datafariui shows still connected icon while actually not
#636 Date text overcomes the widget box size in preview
#645 Solr Connector - Catch error 500 arrayindexoutofboundsexception
#652 Docfilter connector : add default values for exclude filters
#653 WinShare connector : ignore errors
#654 Incorrect EN label for To in date facet
#655 Incorrect FR text
#656 Incorrect EN/FR text for privacy settings popup
#657 Incorrect link to share preview page
#658 DatafariUI - add a search button to the search bar
#659 DatafariUI - Cannot click twice in autocomplete
#660 DatafariUI - full title not always present with mouse over
#661 DatafariUI - weird timestamp with creation date
#663 DatafariUI - merge settings and user upper right menu
#664 DatafariUI - some files have missing meta attributes in preview
#668 Update the documentation about Datafari API
#669 Limitation of the number of indexed tokens
#671 datafariUI - Cannot declare twice a date manually
#672 DatafariUI - Change default favicon
#676 Number of pages in the page navigation bar may go crazy
#677 Add the source facet by default
#678 Do not display replacement characters in Preview Mode
#679 Do not keep the current results pagination when selecting a facet
#680 Prune out extra CRLF in preview mode
#682 Handle non alphanumeric characters for the graphical change of OpenDistro searchexpert and searchadmin account
#683 DatafariUI - missing title for help popup
#685 DatafariUI - Keep search icon to the right but make it more visually distinct
#687 Do not display replacement characters in Search results mode
#689 DatafariUI - selected language not used in the admin UI
#692 Admin UI - Wrong path to opendistro admin
#695 DatafariUI - hierarchical facet
#696 DatafariUI - new suggester for entities at autocompletion
#702 Search alerts not working
#709 [DATAFARI-325] Propose an option to force restart
#711 DatafariUI - hide autocomplete sections when they are empty
#712 datafariUI - hierarchical facet display and counting issues
#713 Support Debian 11 Bullseye
#714 Adblock can block JS scripts
#715 DatafariUI - display version info in an "about" menu
#719 403 error when trying to login in HTTP mode
#720 DatafariUI - Assess accessibility Nov 2021
#721 DatafariUI - preview empty for some docs
#724 ZK-MCF : Too many connections from /127.0.0.1 - max is 1000
#726 Log4j 2 CVE-2021-45105 vulnerability
#731 Change default answer for init script
#732 RAM initialization per server role and type
#734 Change MCF password into monitoring scripts
#735 5.1 - Log4j 2 CVE-2021-44228 vulnerability
================== 5.0 ==================
Feb. 2nd, 2021
* Version of major components :
- Solr 8.5.2
- ManifoldCF 2.18
- Tomcat 9.0.38
- Cassandra 4.0-beta1
- PostgreSQL 12.4
- Zookeeper 3.5.5
- Tika (embedded in MCF) 1.21
- OpenDistro 1.9.0
- ElasticSearch 7.8.0
- Kibana 7.8.0
- LogStash 7.8.0
### Bug
DATAFARI-519 Admin UI - error when changing elk service user password
DATAFARI-507 Aggregator - All tab not clickable after a specific filtered search
DATAFARI-506 Aggregator mode - Missing tabs
DATAFARI-504 Aggregator mode - Spellcheck bug
DATAFARI-503 Strings concatenated for multivalued false at indexing time
DATAFARI-499 Backup/Restore UI - Restore timeout too short
DATAFARI-492 Reactivate MCF backup/restore functionality in CE
DATAFARI-488 Popup "Loading data" for data crawling reinitialisation does not go away
DATAFARI-475 Search UI - Scrollbar not fully functionnal
DATAFARI-471 Simplified Web connector - forbid whitespaces in Repo name field
DATAFARI-465 The french version of the privacy policy page has encoding problems
DATAFARI-449 Extension icons not displayed for Firefox
DATAFARI-440 Button for external elk config has disappeared
DATAFARI-439 Tika error when crawling a website
DATAFARI-390 Admin menu link to solr/elk does not work with Edge
DATAFARI-142 Remove the appender errors at Datafari startup
### Improvement
DATAFARI-510 Admin UI - Change label backup and restore MCF
DATAFARI-508 Tags cloud - remove bold param from font used
DATAFARI-501 Aggregator - Improve performances of current ranking algo
DATAFARI-500 Aggregator - rework the default algorithm for performance
DATAFARI-477 Doc boost documentation link in admin UI
DATAFARI-474 Handle non alphanumeric characters for the graphical change of MCF admin account
DATAFARI-467 Doc boost admin : sort and search queries
DATAFARI-466 Alert Admin UI - add smtp port option
DATAFARI-462 Preview page - Format dates with human readable format
DATAFARI-452 Simplified Web connector - Add regex to the crawl exclusion list
DATAFARI-448 Date facet selection boxes are too large
DATAFARI-447 Display full facet label text as alt text when truncated
DATAFARI-446 Improve management of docs with no dates
DATAFARI-445 For documents with no dates, default to the zero date in unix format \(1970...\)
DATAFARI-443 Web connector - Update the handeld MIME TYPES
DATAFARI-436 Modify default behavior of error/success messages
DATAFARI-434 Modify the default choices of the Date facet
DATAFARI-433 Make the Date facet title more explicit
DATAFARI-428 Change the generated name for repositories to ease simple history
DATAFARI-420 Replace deprecated components into schema
DATAFARI-407 Remove password field from the alerts management page
DATAFARI-389 Display a "access forbidden" message for admin URL
DATAFARI-378 Set a default hop count and depth for the simplified web connector
DATAFARI-375 Cleanup datafari webapp folder
DATAFARI-373 Upgrade to PostgreSQL 10.7 \(or higher\)
DATAFARI-364 Investigate improvement for doc result preview page
DATAFARI-363 Upgrade ELK to 5.x to opendistro
DATAFARI-150 Update jquery and jquery UI
Increase ProxyPass timeout to 300s Increase AJP timeout to 300s
Speed up init permissions during Datafari initialization
### Task
DATAFARI-502 Alers admin UI- clean up code
DATAFARI-490 Admin - propose the restart functionality in CE
DATAFARI-453 Remove exclude param from simplified web job
### New feature
DATAFARI-461 Fill Description info with meta tag description for html types
DATAFARI-429 Need a link at the footer of the search page, pointing to a GDPR page
Integration of SPRING Security
Admin UI for restart
Java 11 support
Check Python improvement and support for V3 Check user who starts/stops Apache Change redirection Apache
Solr crawling Connector
New API mode to query Datafari
================== 4.4 ==================
* Version of major components :
Solr 7.4
ManifoldCF 2.12
Tomcat 9.0.8
Cassandra 3.11.2
PostgreSQL 10.1
Zookeeper 3.4.10
Tika Server 1.19.1
ElasticSearch 5.6.4
Kibana 5.6.4
LogStash 5.6.4
* New features :
Duplicates detection
New log stats for preview
Realm keycloak ready
Tag cloud widget
Entities autocomplete
TranslatorAnnotator
New top menu
* Bug fixes :
Update maven plugins + reorganize webapp libs
Fix slf4j lib in tomcat-mcf
Maj libs + fix missing slf4 logger for tomcat webapps
Fix for DATAFARI-376 Logs for MCF agent not properly handled
================== 4.3 ==================
* Version of major components :
Solr 7.4
ManifoldCF 2.12
Tomcat 9.0.8
Cassandra 3.11.2
PostgreSQL 10.1
Zookeeper 3.4.10
Tika Server 1.19.1
ElasticSearch 5.6.4
Kibana 5.6.4
LogStash 5.6.4
* New features :
Apache proxy in front of Datafari
Add iptables to prevent direct access to Tomcat / Tomcat-MCF and ELK
Preview UI
Add MetricBeat to ELK
Improve WindowsShare connector
Dedicated folders for custom UI code modifications
* Bug fixes :
Improve emptier connector
Fixes url with special characters
Fixes license
Fixes Solr API : push Solr configuration for many collections
================== 4.2 ==================
Note: As announced a few months ago, the AD admin page is now uniquely available in the Enterprise Edition of Datafari.
* Version of major components :
Solr 7.4
ManifoldCF 2.12
Tomcat 9.0.8
Cassandra 3.11.2
PostgreSQL 10.1
Zookeeper 3.4.10
Tika Server 1.19.1
ElasticSearch 5.6.4
Kibana 5.6.4
LogStash 5.6.4
* New features :
Solr updated to 7.4
ManifoldCF updated to 2.12
PostgreSQL updated to 10.1
Tika Server updated to 1.19.1
DATAFARI-320 Add the possibility to also save facets in the alert
Redesigned menu to simplify the access to parameters and functionalities
Scripts rework
Change main collection name
Session expiration automatically
* Bug fixes :
Fix DATAFARI-324 Add a button to close the database connection error
Fix DATAFARI-327 Delete a user does not delete it's additionnal data
Fix DATAFARI-330 MCF Restore erase everything...
Fix DATAFARI-329 Bug updating synonyms
Fix DATAFARI-331 Pagination numbers disappear
Fix external result widget
More restrictions on simplified jobs
Bugfixes UI mobile
================== 4.1 ==================
* Version of major components :
Solr 6.6.4
ManifoldCF 2.10
Tomcat 9.0.8
Cassandra 3.11.2
PostgreSQL 9.6.5
Zookeeper 3.4.10
Tika Server 1.18
ElasticSearch 5.6.4
Kibana 5.6.4
LogStash 5.6.4
* New features :
Added an interface to manage entity extraction
New queryElevator
Added security to spellchecker and modified author suggester
Categories feature beta version
Add module git plugin
Add security to spellchecker and modified author suggester
Autocomplete entity part
Enable watcher for all config files
Enable Licence key + UI
Reworked ELK dashboards
Log download UI
Basic entity extraction
Added a configuration to disable usage statistics
hl maxanalyzedchars dynamic config
Storing usage logs in Cassandra
Previsualize widget by default
Updated MCF style CSS
mcf-crawl-ui war modified file
Replace org.json by org.json.simple
Update Tika server to 1.18
Synchronized saveProperties
Updated config class part 1
Simplified UI
Changed start/stop order of Tika server, MCF and Tomcat
Changed Cassandra gc.log location
Added maxstatuscount property for MCF UI
Added new metadata to fileshare schema
Zookeeper autopurge
Moved JS function redefinition to a single file
Annotator batch retry mechanism
Added logs for annotator
Autocomplete for advanced search
New query statistics Kibana dashboard
Nested history stats for ELK
Add custom Kibana config file for pre configured SSL
Change the way extensions are detected
Aff file size default facet
Add independent ZK for MCF
HTML extractor transformation connector
* Bug fixes :
Fix Attach repository connectors to DatafariAuthorityGroup
Fix protwords back in schema
Bugfix css advanced search
Bugfix pagination
Bugfix favorites
Bugfix promolink
Fix authent session for httpclient
Fix lack of security SearchProxy
Fixed loading wheel on mobile UI
Fix MCF stop agent
Harmonize Solr Community/enterprise Datafari
Fix MCF stop agent
SearchProxy fix
Fix preview display
Bug fix spellchecker + new unified highlighter
Multi servers script updated
Fix search bar behavior when resizing
Bug fix stop script Solr
Add polyfill.js to index jsp
Fix startsWith function
Bug fix spellchecker
Fix search loading
Fix AD Realm password obfuscation
Fix TableFacetQueriesWidget
Fix tika server JMX xmx to 5120m
Fix several titles
Update Postgres vacuum script
Fix startup on low profile conf
Fix multiple url values
Fix sequence number type in Solr schema
Fix Postgres password in mcf-postgres.properties
manage properties file in UTF-8 charset
Table widget regex fix
Fix Tika annotator metadata-error
Fix Cassandra low startup
Re-enabling Italian language
Fix auto trust certificate for HTTPs module
Fix advanced search expression for basic search
Update scripts for MCF ZK
Change log configuration ZK
================== 4.0.2 ==================
* Changes :
Fix poms
Update footer with Enterprise edition label
Change for generic name tika-config lib in script
Multiple Active Directories management
Change authenticate api mcf
Increase default values Solr RAM
Fix postgres password for crawl statistics
Bug fix exact search advanced search
Multiple Acitve Directory bug fixes
Datafari 4.02 change footer display and logos
ldap i18n adjustments
Fix default langage back to English
Harmonize i18n files
================== 4.0.1 ==================
* Changes :
Bug fix advanced search
Bug Fix DATAFARI-220 : Russian language not visible in the Datafari UI
Bug fix OCR (tesseract no longer integrated in Datafari package)
Abort previous query if not finished when new query is performed
Bug fix autocomplete module
Fix DATAFARI-222 : ELK IP change
Set ZK timeout to 60 seconds
[BETA] Promolinks now handle phrases
[BETA] feature DATAFARI-223 timeout on queries
Reduce suggest maxCollations from 100 to 10
Added OpenLayers as local script
Relative path to SearchProxy
Avoid copy fields duplicates
Added datafari restart script
Added JAVA_HOME/bin to PATH
[BETA] DATAFARI-21-choice-of-date-for-indexed-documents
[BETA] DATAFARI-227-Do-not-upload-managed-schema-file
Fix password deobfuscation DatafariRealm
[BETA] DATAFARI-194 Synonyms etc modification behavior
[BETA] Modification spellcheck threshold
[BETA] DATAFARI-210 storage of email creadentials
Updated test case for AlertsAdmin
[BETA] DATAFARI-237-238 postgres password management
spellcheck fix
Fix DBContextListener
Fix promolink behavior
Remove hardcoded paths from start script
Bug Fix HL
[BETA] Added label for On/Off AD activation
[BETA] Added Tomcat restart warning message to AD configuration UI
[BETA] Mapped exact expression to exactContent and exactTitle for basic search
[BETA] Keep facets when sort mode is changed
Fix autocomplete errorHandler
================== 4.0.0 ==================
* Changes :
Removed location_rpt from Solr schemas
Tika updated to version 1.16 for both MCF and Solr
Manifold CF updated to version 2.8.1
Solr updated to version 6.6.1
Elasticsearch updated to 5.6.4
Logstash updated to 5.6.4
Kibana updated to 5.6.4
Various bug fixes
================== 3.2.0 ==================
* Changes :
Tika updated to version 1.15
Manifold CF updated to version 2.6
Cassandra updated to version 3.10
New UI
New Advanced Search
New languages :
- German
- Portuguese/Brazilian
Various bug fixes
================== 3.1.0 ==================
* Changes :
Tika updated to version 1.14+
Manifold CF updated to version 2.5
Improved security for Active Directory connections
Improved security for Tomcat JNDI Realm
Auto-configuration of ELK on the first start of Datafari
Bug fixes for Likes/Favorites and other features of the admin UI
Fix saved search for IE
================== 3.0.0 ==================
* Changes :
Solrcloud on a single node activated by default
Added query elevator admin fonctionnality
Solr updated to version 5.5.1
Postgres updated to version 9.5.3
Usage of Tika embedded in MCF instead of Solr
================== 2.2.1 ==================
* Changes :
Alerts fix
Bug fixes for Internet Explorer : display of the Admin UI
================== 2.2 ==================
* Versions of Major Components
---------------------
- Apache Solr 5.2.1
- Apache ManifoldCF 2.3
- Apache Cassandra 2.1.8
- PostgreSQL 9.3
- Tomcat 7.0.65
- Java Oracle JDK 1.8u66
---------------------
* Main changes :
Project on Maven
JVM Oracle JDK 1.8u66
Spellcheckers fixes
ELK added
Migrate i18n to JS
Special characters display fix
Added Apache Jena dependencies + New OntologyUpdateProcessor
New pages for Statistics
Previsualize Widget added
Federated Search widget added
Start and stop scripts are for non root user
Custom Solr configuration folders added
SEGY and LAS parsers for Tika added
Tab widget added
Advanced Search widget added
Field weight page : bug fixes
MCF plugin for Solr 5
MCF updated to 2.3
MCF autoresize UI fix
AD fixes
Backup/Restore MCF configuration added
================== 2.1.3 ==================
Cassandra startup fix
Fix BackupManifoldCFConnectorsScript package change
Update datafari.properties : Set ALLOWLOCALFILEREADING to false by default as it is a security leak
================== 2.1.2 ==================
Add several roles to new user fix
AD domain SearchProxy fix
Removed roleBase from JNDI realm to avoid errors
Logout from ManifoldCF when logout from Datafari
================== 2.1.1 ==================
Bug fixes in the AD User UI
Translation AD UI
================== 2.1 ==================
[DATAFARI-42] Fix "Impossible to login after several restarts" issue
Tomcat version is 7.0.65 instead of 7.0.40
Hierarchical Facet feature added :
- [DATAFARI-61] Hierarchical facet pagination
- [DATAFARI-46] Hierarchical facet pagination
Facet fixes :
- [DATAFARI-55] Hide facets when they have no content
- [DATAFARI-45]Facet pager not displayed
OpenSearch compatible format
Development environment for Mac OS X supported
Italian translation
Active Directory feature fix :
- [DATAFARI-47] Domain hardcoded in the servlet SearchProxy
- [DATAFARI-50] 403 error after login of an basic AD user
- [DATAFARI-77] Cannot assign several roles to a datafari user
- [DATAFARI-48] Add AD/LDAP user role by the UI
- [DATAFARI-76] The "Modify a user" admin UI shows role table users
- [DATAFARI-75] User suppression shows error
- [DATAFARI-74] User roles suppression
================== 2.0 ==================
- New User Interface with responsive design :
Search interface
Admin interface changed with Devoops framework
- New features added :
Favorites
Alerts (experimental)
Schema analysis
Field weight configuration
Facet congiguration (experimental)
Deduplication
Likes (experimental)
LDAP configuration (experimental)
- Architecture changed
Solr is now in 5.2.1 with a standalone server application (Jetty)
Cassandra 2.1.8