{"id":4571,"date":"2019-02-11T00:00:00","date_gmt":"2019-02-10T23:00:00","guid":{"rendered":"https:\/\/www.ieec.cat\/gaia-dr2-bulk-catalogue-available-in-fapec-format-2\/"},"modified":"2022-12-22T23:19:35","modified_gmt":"2022-12-22T22:19:35","slug":"gaia-dr2-bulk-catalogue-available-in-fapec-format","status":"publish","type":"post","link":"https:\/\/www.ieec.cat\/en\/gaia-dr2-bulk-catalogue-available-in-fapec-format\/","title":{"rendered":"Gaia DR2 bulk catalogue available in FAPEC format"},"content":{"rendered":"

[et_pb_section fb_built=”1″ fullwidth=”on” theme_builder_area=”post_content” _builder_version=”4.14.8″ _module_preset=”default” height=”114px” background_color=”” hover_enabled=”0″ sticky_enabled=”0″ title_text=”” background_image=”\/wp-content\/uploads\/2022\/04\/slider-corpo2.jpg”][\/et_pb_section][et_pb_section fb_built=”1″ theme_builder_area=”post_content” _builder_version=”4.14.8″ _module_preset=”default” custom_padding=”||0px||false|false” custom_margin=”||0px||false|false” hover_enabled=”0″ sticky_enabled=”0″][et_pb_row _builder_version=”4.14.8″ _module_preset=”default” theme_builder_area=”post_content”][et_pb_column _builder_version=”4.14.8″ _module_preset=”default” type=”4_4″ theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.8″ _module_preset=”default” theme_builder_area=”post_content” _dynamic_attributes=”content” hover_enabled=”0″ sticky_enabled=”0″ custom_margin=”0px||0px||false|false” custom_padding=”0px||0px||false|false”]@ET-DC@eyJkeW5hbWljIjp0cnVlLCJjb250ZW50IjoicG9zdF90aXRsZSIsInNldHRpbmdzIjp7ImJlZm9yZSI6IjxoMSBjbGFzcz1cImVudHJ5X3RpdGxlXCI+IiwiYWZ0ZXIiOiI8L2gxPiJ9fQ==@[\/et_pb_text][et_pb_text _builder_version=”4.14.8″ _module_preset=”default” theme_builder_area=”post_content” _dynamic_attributes=”content” custom_padding=”0px||0px||false|false” custom_margin=”0px||0px||false|false” hover_enabled=”0″ sticky_enabled=”0″]@ET-DC@eyJkeW5hbWljIjp0cnVlLCJjb250ZW50IjoicG9zdF9kYXRlIiwic2V0dGluZ3MiOnsiYmVmb3JlIjoiIiwiYWZ0ZXIiOiIiLCJkYXRlX2Zvcm1hdCI6ImN1c3RvbSIsImN1c3RvbV9kYXRlX2Zvcm1hdCI6IlktbS1kIEg6aTpzIn19@[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=”1″ _builder_version=”4.14.8″ _module_preset=”default” custom_margin=”0px||||false|false” custom_padding=”0px||||false|false” top_divider_color=”RGBA(255,255,255,0)” top_divider_height=”0px” hover_enabled=”0″ global_colors_info=”{}” sticky_enabled=”0″][et_pb_row column_structure=”4_4″ _builder_version=”4.14.8″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.14.8″ _module_preset=”default” global_colors_info=”{}”][et_pb_image src=”https:\/\/www.ieec.cat\/wp-content\/uploads\/2022\/12\/1549895709_38d9340005fce026b33f24800be14799_logo_01_rgb_small.jpg” alt=”Gaia DR2 bulk catalogue available in FAPEC format” _builder_version=”4.14.8″ _module_preset=”default” title_text=”PR_Image1.png” hover_enabled=”0″ sticky_enabled=”0″ width=”600px” module_alignment=”center”][\/et_pb_image][et_pb_text _builder_version=”4.14.8″ _module_preset=”default” global_colors_info=”{}”]The Gaia group at the Universitat de Barcelona (IEEC<\/a> – ICCUB<\/a>), in cooperation with DAPCOM Data Services S.L.<\/a> (a technological spin-off company of the UPC<\/a> and the UB<\/a>), has published an alternative copy of the bulk data files from Gaia DR2<\/a><\/strong> – the second data release from Gaia.<\/p>\n

Gaia DR2 was published on 25 April 2018. Besides the on-line catalogue<\/a>, bulk CSV files were also made available for download – an interesting option for exhaustive analyses. Such files are officially offered in “csv.gz<\/em>” format, that is, compressed with the widely known gzip<\/em> compressor.<\/p>\n

On 6 February 2019, DAPCOM released FAPEC Archiver 19.0, a professional data compression software offering high compression ratios at high speeds. One of the options provided is the compression of tabular (CSV-like) text files, such as those from the bulk Gaia DR2. As a demonstration of the capacities of FAPEC, DAPCOM converted the full Gaia DR2 bulk CSV files to the FAPEC format, reducing the total size from 554 GB to 471 GB<\/strong> – that is, 15% smaller than with gzip<\/em><\/strong>. Other data compressors like bzip2<\/em>, rar<\/em>, Zstandard<\/em> or 7-zip<\/em> cannot reach this mark. Specifically, for the largest tables:
\n <\/p>\n