Data Explorer Release Notes

The core technologies and datasets that make The Data City work have improved enormously in the past seven years.

In December 2019 our Data Explorer product contained 100GB of data on the UK’s companies. In December 2020 that number was 200GB. In December 2021 it was 400GB.  As of September 2023 it is now 600 GB. Despite this growth, classification speed has increased by a factor of five hundred. We are exceeding our >99.99% uptime target, beating our target for 2024 of achieving speed and stability while adding new features.

Using machine-learning and instant keyword filtering, our unique process lets users classify companies into sectors of the economy not covered by SIC codes. They are achieving more in days and weeks than they used to in months and years.

v4.20 (released October 2024)

New features

• Introduced Real-Time SIC Codes (RSICs) where we use AI to assign company SIC codes where they are missing, incorrect or vague.
• Our all new Smart Search tool allows our users to search the entire UK business base using keywords, phrases, concepts, and even complete sentences.
• Added some example queries to the Smart Search page.
• For company profiles added details on whether an individual funding round contributes to the companies total funding received.

New data or data upgrade

• Added codes to downloads from Analyse where available.
• Data from our RTICs page can now be exported.
• Removed Dealroom funding round types that do not contribute to overall total from Analyse results.
• Added RSIC business counts, turnover and employee count widgets to Analyse page.

Performance improvements and bug fixes

• Improved layout of sector charts in Analyse.
• Time-series jobs and skills data is now displayed in barchart format.
• Fixed broken company webpage links on report an RTIC modal.
• Fixed date formatting for individual Dealroom funding round details.

v4.19 (released October 2024)

New features

• All URL-matched companies have newly taken webpage screenshots.
• Added new company icons to company details in lists.

New data or data upgrade

• Companies house data updated to September 2024 incorporated.
• Added yearly reported employee count to download fields.
• Improved URL matching for the top 15,000 companies in the UK.
• ~600 previously unmatched companies now have a URL.

v4.18 (released September 2024)

New features

• All new interactive product walkthrough making it easier for new users to learn to use the product.
• Added company trade data on number of companies importing and exporting available to ANALYSE page.

New data or data upgrade

• Updated constituency boundaries and company locations to match 2023 review. 

Performance improvements and bug fixes

• Fixed behaviour of “New” and “Revised” RTIC tags on RTICs page.
• Fixed some layout issues in filter controls.

v4.17 (released July 2024)

New features

• Improved report a company RTIC functionality. RTIC mismatches and RTIC suggestions can now be submitted for any company.
• Improved report a company CIC functionality. CIC mismatches and CIC suggestions can now be submitted for any company.
• EXPLORE, ML lists and Analyse – New company has export & import data filters.
• Export & import data available on a per company basis on company profile pages.
• New similar companies tab on company profile page. Contains a compact view of company details.
• Improved ML list and Explore downloads. You can now select individual data fields for a fully customisable download.
• Added new postcode outcode filter to all pages.
• Improved RTIC search functionality on All RTICs page. Quickly navigate to RTIC sectors and verticals of interest.
• Added total companies used for growth percentage calculation in Analyse summary.
• Improvements to filtering UI.

New data or data upgrade

• New HMRC trade data. We’ve matched our existing dataset with a data source from HMRC on exporters and importers. This allows us to more accurately say which companies are importing and exporting, and which goods they are trading. 
• Improved location quotient data. Created consistency in location quotients between the RTICs and Sectors, and Locations sections of analyse.
• We’ve revised our Lightcast data. The data is underpinned by a new matching process between Companies House number and Lightcast ID. As well as improving the accuracy of the matching, we’ve improved our coverage of Lightcast’s data. We now match 6 times as many unique Lightcast IDs.
• We’ve made a minor adjustment to how the growth rates of a list are calculated. To calculate the estimated growth rate of a list, we sum the number of employees across each year in the list. We now require companies to have at least 3 years of reported employees to be included in the growth rate calculation.  
• Improved similar company data.
• Added new fields to Explore and ML list downloads: best estimate employee growth percentage per year, best estimate turnover growth percentage per year,  SIC code descriptions, tonnes of CO₂ per year.

Performance improvements and bug fixes

• Performance improvements to Analyse page. Results are now returned up to four times faster.
• Fixed bug where mis-formatted company URLs would cause the resolving of training set company URL changes to fail.
• Fixed bug where Analyse processing would fail if filtering by ultimate parent nation.
• Analyse widgets are now not displayed if the required data is unavailable when view data by location quotient is active.
• Fixed alignment of score elements in company lists.
• Fixed batch control behaviour of Dealroom funding rounds filter.
• General page layout improvements.

v4.16 (released June 2024)

New features

• Short notes can now be added to manual includes/excludes on a per company basis in ML lists.
• Short notes can now be added to positive/negative training sets on a per company basis in ML lists.
• Added sort results by company search match option when using company name/number/URL filter in EXPLORE and ML lists.
• Amended some tooltips and added new links to our knowledge base.
• Users can now resolve URL changes in their ML list training sets, by deciding whether to keep or remove affected companies.
• Companies with a mismatched URL report awaiting review will now be highlighted to all users.

New data or data upgrade

• Companies house data updated to June 2024 incorporated.

Performance improvements and bug fixes

• When using company search box for filtering results will now be sorted by company search match by default.
• Fixed bug whereby the update results button would not appear when changing keyword filter And/Or options.
• Improved layout of bar labels in RTIC vertical charts in ANALYSE.
• List notes are now shared when an ML list is shared with another user.
• Fixed bug in COMPARE where missing data in job postings time series would cause processing to fail.
• Limit results to registered address only option will now be respected when using postcode filter.
• General page layout improvements.

v4.15 (released May 2024)

New features

• Fully revamped user interface.
• The main navigation pane has moved from the top to the lefthand side of the page, making the navigation elements easier to reach.
• The ML list building process has been streamlined. Users can easily see and review their list without having to scroll to the top of the page.
• Company filtering is now more intuitive.  A new filter update button and popup has been added which ensures your filters changes are reflected in your results. This means that the companies you are seeing are always aligned with the filters that you have applied at that instance.
• UI improvements to list select and options elements.
• Added filter companies by postcode option. Users can now find all companies within a customisable radius of a postcode.
• Added new Dealroom funding round filter.
• Short notes can now be added to Explore and ML lists.

New data or data upgrade

• Companies house data updated to April 2024 incorporated.
• Updated Lightcast data on jobs and skills.

Performance improvements and bug fixes

• Updated company screenshots to reduce filesize.
• Whitespace is now removed from company name search input before filtering.
• When EXPLORE and ML lists are copied they will also be added to the same folder as the original list.
• Folder search will now correctly handle special characters in folder names.
• Fixed bug whereby manual included and excluded companies would be cleared in ML lists if filters were reset.

v4.14 (released April 2024)

New features

• Added all companies struck off from Companies House since 2017. This increases the total number of available companies in the platform to more than 9 million.
• Added company status filter for toggling between active, dissolved, or other company states.
• Sort ML and Explore list companies by their last known active date.
• Added search for a folder functionality to My Lists page.
• New outliers filter allows you to exclude anomalous companies, or inspect only the outliers.
• New knowledge base tooltips.
• Added new “Has jobs and skills data?” companies filter for users with Lightcast data access.
• Added sort ML and Explore lists by total job posts option for users with Lightcast data access.
• EXPLORE lists can now be organised into folders.
• Improved job postings by SOC4 data visualisations for users with Lightcast data access.

New data or data upgrade

• Companies house data updated to March 2024 incorporated.
• Added dissolved companies since 2017.
• Added location quotient data into the COMPARE page.
• Added Gross Value Added (GVA) summary data to ANALYSE page.
• We have identified likely anomalous company financial accounts, using a model trained on confirmed anomalous financial accounts. Anomalous financial and employee data is flagged up on company profiles and summarised in ANALYSE.
• Added company status data to ANALYSE and COMPARE.
• New job insights data in ANALYSE. Users with Lightcast access can now see the total job postings over time.
• New job postings data by RTICs and CICs available in ANALYSE and COMPARE.
• New company births and deaths data in ANALYSE. See summaries of how company formation and dissolution vary over time for a sector.

Performance improvements and bug fixes

• Fixed issue on My Lists page where if the user had a large number of folders the elements at the bottom of the lists could not be accessed.
• When a new ML list is created from inside a folder it will now automatically be saved to that folder.

v4.13 (released February 2024)

New features

• Added ESG statement details to company profile pages.
• Added filter to limit results to companies with ESG statements available.
• Added new tooltips with links to new Knowledge Base articles.
• Added field availability summary table to ANALYSE.
• Layout improvements for ML list training set company search results.
• Added control to reset founder gender filter.
• Added ability to search by vertical code in RTIC details page.

New data or data upgrade

• Companies house data updated to February 2024 incorporated.
• Added ESG statements data.

Performance improvements and bug fixes

• Fixed bug where company CIC details were hidden from the results when using the company search box in EXPLORE and ML lists.
• Companies sharing the same URL can no longer be added to both the positive and negative ML training sets simultaneously.
• Fixed some missing icons in UI.
• Fixed bug on Define page where add all search results would not work if a company was removed from the training set.
• Updated some labels on ANALYSE page.
• Removed ability to see location quotient data in ANALYSE when a location filter is active.
• Fixed alignment of filter tooltips.
• Fixed show more data control for Company Founding Dates bar chart in ANALYSE.

v4.12 (released December 2023)

New features

• Added links to the new our brand-new Knowledge Base.

New data or data upgrade

• Companies house data updated to December 2023 incorporated.

Performance improvements and bug fixes

• Fixed layout issues with filter tooltips.

v4.11 (released November 2023)

New features

• Filter by Women Led and Women Founded businesses.
• Full overhaul of Analyse page UI – widgets are now grouped into subsections and share controls.
• NUTS region widgets in Analyse have been replaced by newer ITL regions.
• Filter by ITL1 and ITL2 regions.
• In Analyse map markers are now clustered to prevent overlapping.
• Added founder gender widget to Analyse.
• Improved layout of tables of data in company profile pages.
• Updated summary data in Compare page to match fields available on Analyse page.
• Added codes to location fields in Analyse.
• Major UI simplifications.

New data or data upgrade

• Companies house data updated to November 2023 incorporated.
• Company GVA estimates now use all SIC codes.
• Women Led and Women Founded business data and filters.
• Replaced company growth stage filter with improved company size filter.

Performance improvements and bug fixes

• Major UI corrections.
• Fixed bug where lists were not being removed when moved to a new folder on My Lists page.
• Fixed incorrect formatting of negative values in Analyse page barcharts.

v4.10 (released October 2023)

New features

• Users with access to Lightcast data can now see charts of job postings over time in company profiles.
• Improvements to filters search – filters can be quickly grouped by code and added in one click.
• Added new data widgets to Compare page.
• Added new filters to Compare page, including growth filters.
• Improvements to Analyse widget tooltips.

New data or data upgrade

• Companies house data updated to October 2023 incorporated.
• New job postings over time data by Lightcast.

Performance improvements and bug fixes

• Fixed some format issues with address data.
• Fixed some incorrect labelling of charts in Analyse.
• Fixed bug where destination folders would be unavailable when attempting to move multiple lists.

v4.9 (released September 2023)

New features

• Added limit results to University spinouts filter.
• Improvements to filter searches by SIC code.
• For ML list training sets users will now see an alert if a company’s matched URL has changed since the list was created.

New data or data upgrade

• Companies house data updated to September 2023 incorporated.
• Improvement to categorisation of company growth stages.
• Improved GVA estimates are available for four times as many companies.

Performance improvements and bug fixes

• For ML lists the training set UI will always display the most up-to-date URL match for a company.

v4.8 (released August 2023)

New features

• Streamlined the welcome process for new users to the platform.
• Added welcome videos and features checklist.
• Improved functionality on RTICs summary page – quickly visualise a sector in Analyse or Explore.
• Mismatched RTICs can now be reported at the vertical level.
• Suggest an RTIC vertical for a company functionality.
• Added OECD scaleup definition filter.
• Added company status to company profile page.
• Breakthrough sectors at a regional level are available on the RTICs summary page.

New data or data upgrade

• Companies house data updated to August 2023 incorporated.
• Where available added auditor name in company financials.
• Fixed a bug whereby early rounding of numbers left the Estimated Turnover and Estimated Employee Count of companies slightly different in different places.
• Added OECD scaleup definition data.
• Downloads now include Estimated Turnover, Estimated Employee count and Total Innovate UK funding data.
• New Dealroom data on investment funding.
• New Creditsafe data on company financials.
• New 360 Giving data on grant funding.
• Improved URL matching.
• Improved company Innovation Score data.
• In Analyse Dealroom funding by year data now ignores debt and acquisition.

Performance improvements and bug fixes

• Fixed issues in Compare where certain fields would use different data for calculation to Analyse.
• Fixed loading of RTIC filters from saved Explore lists in Compare page.
• Fixed currency rounding errors on turnover figures in Analyse.
• Search speed increased by >100%.

v4.7 (released July 2023)

New features

• Multiple ML lists can now be shared, moved or deleted simultaneously on the list select page.
• Company URLs remain highlighted across the page once visited.
• Added sticky navigation for filter controls on Explore, ML list and Analyse pages.
• Added quick navigate to list analysis button on Explore and ML list pages.

New data or data upgrade

• Companies house data updated to July 2023 incorporated.
• Added estimated gross value added (GVA) for companies.
• Added OECD scaleup flag for companies.
• Added Estimated Employee count and Estimated Turnovers to company downloads.

Performance improvements and bug fixes

• Fixed bug where changing ML list folder names would not be updated in the UI.
• Fixed rounding errors in currency data on Compare page.
• Sped up full text searches for keyword filtering.
• Fixed a bug whereby early rounding of numbers left the Estimated Turnover of companies slightly different in different places.

v4.6 (released June 2023)

New features

• New tooltips and explanations for growth filters.
• Added investor name to funding details.

New data or data upgrade

• Companies house data updated to June 2023 incorporated.
• Coverage of EBITDA data has been expanded to over twice as many companies (approx. 70k to approx. 170k).
• Refreshed Innovate UK and 360 Giving grants data.

Performance improvements and bug fixes

• Fixed bug with EBITDA filtering.
• Improved company profile mobile view layout.
• Fixed bug whereby data from Dealroom wasn’t being used to estimate company size properly.

v4.5 (released May 2023)

New features

• New growth filters tab, including filter by company growth rate.
• Improved filter by minimum innovation score slider.
• New company profile UI, including new growth data tab.
• Added new location specific estimates in ANALYSE summary box.
• Added CICs to company information for ML lists and EXPLORE page.
• Added report a mismatched CIC option.
• Added new tooltip to ANALYSE summary box.
• Exclude foreign companies option added to Companies filter.
• New turnover estimates chart on company profile page.

New data or data upgrade

• All new estimates for company employee count and turnover.
• Improved projected values for employee count and turnover – values are now available per year for each company.
• Estimates of turnover and employee count for RTICs are much improved.
• Improved analysis of skills by better accounting of duplicate job postings and adjusting for the effect of recruiters.
• Improved analysis of jobs by better accounting for postings by groups of companies.
• Added Company growth rate widget to ANALYSE.
• New estimates for employee count by year in ANALYSE – values are now projected into past and future years.

Performance improvements and bug fixes

• Fixed sorting by innovation score.
• Corrected ordering of company growth stage filter.
• Fixed bug where if a large number of manually added or excluded companies were associated with a list they would be ignored from ANALYSE calculations.
• Fixed bug where filtering by Ultimate parent company nation would return no companies.
• Fixes to downloads to align download data with EXPLORE page.

v4.4 (released February 2023)

New features

• Added charts showing measured and projected company employment numbers.
• Added per round Dealroom funding data table to company lists.
• Added spinout details to Dealroom funding data.
• Ordering of company locations updated to include registered location first.
• Updated some tooltips.
• Added EULA page.
• Added CICs and report mismatched CIC to company lists.

New data or data upgrade

• Companies house data updated to February 2023 version.
• Improved website match reasoning data.
• Improved and updated international currency conversions.

Performance improvements and bug fixes

• Fixed bug where about 6000 companies had more than one registered address.
• Fixed a problem whereby some local authorities created in 2021 had fewer employees reported than expected.
• Fixed RTIC percentage growth sign formatting on RTICs summary table.
• Fixed navigate back to list buttons on company and director profile pages.
• Fixed issue where company details content would occasionally be truncated in company lists.
• Fixed issue where RTICs page would fail to load if a summary was not available for a particular sector.
• Fixed issue where company page would fail to load if it had grant funding data.
• Fixed calculation of growth percentage on Cumulative growth of companies ANALYSE widget.
• Fixed ordering within company growth filter.
• Fixed issue where manual included and excluded companies list would occasionally be truncated in ANALYSE.

v4.3 (released December 2022)

New features

• RTIC ranking and summary tables now available.
• RTIC summary tables can now be filtered by region.

New data or data upgrade

• Companies house data updated to December 2022 version.
• General availability of Lightcast data on jobs and skills (Available on Request, please contact us for pricing details).
• Improved salary and posting duration data from Lightcast available in analyse.
• Four new job skills breakdowns available – software skills, certifications, common skills, specialised skills.
• Improved company growth estimates.
• Improved Dealroom data on funding – dates of multiple funding rounds, total funding raised and raised series.
• Dealroom data is now incorporated in company growth stage estimates.
• Improved URL matching quality.
• Increase of companies with URL matches to 1.68 million.
• Improved website match reasoning.

Performance improvements and bug fixes

• Fixed bug where full download of ANALYSE results would occasionally fail.
• Up to 4x improvement in speed of ML list building.
• Fixed a bug where the RTIC sector counts widget in ANALYSE would sometimes report more companies per RTIC than there were companies in a list.
• Fixed a problem whereby some local authorities created in 2021 had fewer employees reported than expected in ANALYSE.
• Fixed a bug where some companies had more than one registered address.

v4.2 (released November 2022)

New features

• Filter by company growth stage estimates (startup, scale-up, established business, unicorn etc…).
• Company growth stage results now available in ANALYSE.
• See score distribution of all classified companies for ML lists.

New data or data upgrade

• Company growth stage added to list downloads.

Performance improvements and bug fixes

• Fixed bug where full ANALYSE results download file was unavailable.
• Faster loading of previously classified ML lists.
• Faster loading of ML lists – classifier explanation now returned with company results.
• Faster location quotient calculations now performed server side in ANALYSE.
• Faster loading of All RTICs summary page.

v4.1 (released October 2022)

New features

• Median company growth rate estimates are available for lists in ANALYSE.
• Company stage estimates (startup, scale-up, established business, unicorn etc…) available in the product.
• Added CIC results to ANALYSE.
• Improved line charts in ANALYSE.

New data or data upgrade

• Improvements to company growth score estimates. (switch to ln-based estimates)
• Improved ordering of companies when filtering by company name.

Performance improvements and bug fixes

• Improvements to layout on mobile.
• Fixes to RTIC and CIC filtering.
• Faster processing of RTICs and CICs on page load.
• Fixed issue where company details page would fail to load if it had no shareholder information.
• Fixed bug where explain company score results would fail to load.
• Fixed bug where filtering by certain company categories would cause a failure.
• Fixed issue with company name filtering.

v4.0 (released September 2022)

New features

• Increased accuracy of classification. Your lists may be slightly smaller. Add more positives to the training set if required.
• Company growth estimate now included in ML lists and EXPLORE.
• New financial filters – EBITDA and total Innovate UK funding.
• New Innovate UK funding widgets in Analyse.
• One click export of company URLs enables easier use of data with external providers such as Hunter.io’s Bulk Domain Search.
• Improved EBITDA data.
• Sort lists by company growth estimates or total Innovate UK funding.
• New Dealroom funding filter, you can now include companies where funding is unknown when filtering.

New data or data update

• English and Welsh geographies updated to 2021 census, and recent local and regional government reorganisations.
• Companies house data updated to September 2022 version.

Performance improvements and bug fixes

• Instant classification. Average time to classify 1.6 million companies reduced from 10 minutes to 10 seconds.
• Improved performance when loading RTICs and CICs into the platform.
• Fixed layout issues with line charts in ANALYSE.
• Fixed director’s appointment date field.

v3.3 (released August 2022)

New features

• Company emails are now matched to which company director they might belong to.
• Individual company profile pages now contain all available data fields including group structure, funding and shareholders.
• New instantly print a company profile control.
• New download options and formats (XLS, CSV and JSON) for company profiles.

New data or data update

• EBITDA data is now available for companies in ML lists, EXPLORE lists and company profiles.

Performance improvements and bug fixes

• Fixed bug that prevented directors pages from loading data.
• Fixed bug where including single quotes in keyword filters would prevent lists from being processing. Single quotes are now automatically changed to double quotes.
• Manually included and excluded companies in ML lists are now added to copied and shared versions of the list.
• Improved formatting of company data in EXPLORE and ML lists.

v3.2 (released July 2022)

New features

• Updated “My lists” page now contains details of all types of list – ML list, EXPLORE list and CICs.
• Added new tooltips and explainers.
• New add many companies functionality for manually included or excluded companies in ML lists.
• Company score is now always visible in ML lists results regardless of what property the list is being sorted by.

New data or data update

• Updated website screenshots, increasing count from 700,000 to 1,600,000.

Performance improvements and bug fixes

• Fixed bug where downloads of ML Lists were not correctly ordered by score.
• Fixed bug where removing a company from a training set and then filtering the list would cause the list to be rebuilt.
• Fixed layout issues for ML list score elements on small-width devices.
• In ML lists sorting via keyword ranking position will no longer automatically be applied if filtering by keywords is active.

v3.1 (released June 2022)

New features

• Added location filter for company’s ultimate parent nation.
• Added option to filter out company’s that are known to be ultimately foreign-owned for EXPLORE and ML Lists.
• Included the CIC filter in it’s own section, allowing comparisons between different sectors to be performed.
• Updates to ANALYSE and COMPARE pages. Easily navigate to different sections with the new controls.
• New fields in ANALYSE and COMPARE – investment funding via Dealroom and Innovate UK grant funding.
• Added parent nation and ultimate parent nation to group structure details in EXPLORE and ML Lists.
• Downloads of ML and EXPLORE Lists are now available in JSON format.
• New group structure fields and updated financial data years available in downloads of ML and EXPLORE Lists.
• Improved filters UI in mobile view.

New data or data update

• Data refresh based on Companies House records June 1st 2021.
• Full update of company director details, including fixing the capitalisation of names.
• Full update of financial data, including shareholdings, group structure, and beneficial ownership.
• Funding data from Innovate UK and 360 Giving.

Performance improvements and bug fixes

• Faster page loading.
• Faster server maintains speed even with many users.
• Fixed incorrect units for currency and location quotient fields in ANALYSE.
• Improved company search results – more relevant companies will appear higher up in the list.
• Fixed missing icon images.
• Fixed bug where company website links in search results were broken.
• Removed list size options from ML list creation process.

v3.0 (released May 2022)

New data or data update

• More accurate company URL matches.
• Improved website data for all companies.
• More business locations.
• Company funding data provided by Dealroom.
• Added company group structure data.
• Added company shareholders data.
• Added persons of significant control data.
• Manually include and exclude companies from ML lists without affecting machine learning classification.
• Filter companies by minimum innovation score.

New features

• Improved methods for splitting employees and turnover across multiple operating locations of a business.
• Added new fields to ANALYSE and COMPARE.
• Improved company list UI.
• Added location quotient option to ANALYSE and COMPARE.
• Added percentage option for website keywords to ANALYSE and COMPARE.
• Improved company searches in EXPLORE, the most relevant companies will now appear highest in the results list.

Performance improvements and bug fixes

• Faster page loading.
• Faster filter searches.

v2.6 (released March 2022)

• New COMPARE tool. Easily compare two different sectors or EXPLORE lists through visualisations of overview statistics. Fields such as employees, sectors and financials are included.
• Improved ML lists. Lists are no longer limited in size by a preset return count. Faster loading of lists.
• Improved filtering UI.
• Improved RTICs pages. RTICs now contain unique codes and descriptions.
• RTICs are now tagged as New or Updated if they have been edited within the last month.
• Fixed order of recent EXPLORE lists on homepage.
• Analyse and Compare pages now contain Location quotient options for business counts, employees and turnover by local authority.
• Improved download lists UI.
• Updated company lists UI. See the most important data fields more easily.

v2.5 (released January 2022)

• Faster page loading.
• New company R&D innovation score. Filter and sort by how innovative companies are in ANALYSE and EXPLORE.
• New similar companies measure. For companies in EXPLORE see up to five companies sharing similar characteristics.
• Improved filtering UI in EXPLORE and ANALYSE. Easily access all available filters.
• More data on company turnovers and employee counts provided by Red Flag Alert.
• Added results summary panel to ANALYSE page.
• Added option for basic or detailed downloads on EXPLORE and ML List pages.
• Added sort by Turnover and Keyword ranking score options for EXPLORE lists.
• Faster data downloads.
• Added innovation score, turnover, and similar companies data to ML List page.

v2.4 (released December 2021)

• Data refresh based on Companies House records December 1st 2021.
• Over 1.6 million companies with URLs matched.
• Financials data for 2020 now over 50% coverage, giving accurate 2020 financials through extrapolation.
• Over 5 million companies.

v2.3 (released September 2021)

• Data refresh based on Companies House records September 1st 2021.
• More than 200,000 new companies added to the platform, with 1.25m companies with URLs matched.
• Improved company phone numbers data.
• Improved company email addresses data.
• Improved speed when building ML lists.
• Fixed bug where companies with scores below zero were incorrectly sorted on ML list page.
• UI updates on Define list page.
• Fixed bug where previously deactivated filters would be turned back on after list rebuild.
• RTICs added to individual company pages.
• On EXPLORE page all RTICs for a company are now displayed by default.
• ML list filtering by location can now be limited to registered address only.
• In EXPLORE you can now lock the company numbers filter against filter reset.
• Filtering custom EXPLORE lists will no longer automatically overwrite the saved version.
• All My words used for keyword filtering are now added to shared ML lists.
• Fixed simultaneous filtering of RTICs and company numbers to show proper overlap between companies.
• ANALYSE page now contains list summary data on RTIC sectors.
• Speed improvements on EXPLORE page.
• Added incorporation date filter to EXPLORE and ANALYSE pages.

v2.2 (released August 2021)

• Full data refresh based on Companies House records August 1st 2021.
• Improved URL matching of companies.
• Better company phone number matching.
• More data on directors, now includes details of officer’s past appointments.

v2.1 (released July 2021)

• Integration of v1.x stability into v2.x branch
• Updated design to reflect new Data City branding.
• RTICs are now available to view in the platform. Access individual RTIC lists from the home page to view on the EXPLORE or ANALYSE pages. RTICs can also be used as filters.
• Improved filtering UI.
• Increased maximum ML list download size to 30,000 companies.
• New location options for filtering: LEPs, regions and constituencies.
• Improved interactive line charts on ANALYSE page.
• Save static lists generated in the EXPLORE page. These can be edited, shared or copied.
• Access and edit saved EXPLORE lists from the home page.
• Estimates of per company greenhouse gas emissions is now available on the EXPLORE page.
• Sort ML and EXPLORE lists by properties including company name, employee count and incorporation date.
• New search UI to quickly find companies in your list by name, company number and URL.
• Added a report mismatched RTIC button to companies in EXPLORE page.
• Active filters in ML company lists are now autosaved. Filtered lists can now be shared with other users.
• New print styles for improved output from the platform.
• Improved UI on mobile devices.
• Fixed bug where “My words” would become unavailable if a ML list was rebuilt.

v2.0 (released March 2021)

• Increased company website matching (>1m websites) and improved website matching (<1% error rate).
• Improved list download. Native Excel download and Excel-friendly CSVs. Please note that downloads will have slightly different column headings to the previous version of the product.
• Filters available with a consistent UI in Lists, Data Downloads, and Insights.
• Extended financial data including Debtors due after one year, Debtors, Trade Debtors, Depreciation of Tangibles, Amortisation of Intangibles, Directors Remuneration, Employee Remuneration.
• Estimates of company group structures.
• Fix for a rare bug where a user with multiple lists open at once receives the results from one list in another tab.
• Fix for a rare bug a keyword filter does not return the correct number of companies.
• Fix for a rare bug results for the wrong lists are returned during list building.
• New Disqus user forum to send us feedback on the product.
• The classifier explanation now allows you to see up to 100 terms used during company classification.
• See explanations of individual companies scores on the list page.
• Redesigned company list page now shows company description and homepage screenshot by default.
• Completely new EXPLORE section: Explore details on all 4.7m UK companies. Filter companies by sector, location, financials and keywords.
• List insights improved and renamed ANALYSE.
• Results in ANALYSE can be viewed as barcharts or linecharts as appropriate.
• New interactive maps to explore location data.
• New data points including website keywords, company size and employees by location are now available in the ANALYSE section.
• New company filters in EXPLORE and ANALYSE sections. Paste in a list of company numbers to see either company details or summary statistics of the list.
• You can now filter companies by number of employees.
• Improved “Find a company” functionality on the homepage. Results will now show extended company details.
• In EXPLORE you can now download details of the top 5000 companies in your search results.
• ANALYSE now includes results on webpage keywords, including how over/under-represented they in your sample compared to all companies

v1.7 (released Feb 1st 2021)

• New home page. Instantly access, edit, and share your 10 most recent lists
• Quickly search for companies directly from the home page.
• Added search functionality to list select pages.
• Included additional opportunities to report missing and mismatched companies on the find a company and company details pages.
• Fixed some issues with company details downloads.
• Fixed bug where you could not access director details for companies with more than five directors on the company details page.
• Layout improvements on the company list page. Some details are now arranged in a column structure.
• Fixed bug where sometimes the correct score setting was not carried across from the list page to the insights page when filtering.
• Fixed downloads of Top 10 company financials on the insights page.
• Trial users can now see 60 companies in their lists.

v1.6 (released Jan 1st 2021)

• The creation of a Long Term Support level product in the 1.x branch.
• Feature development of the 1.x branch will be frozen and all efforts shifted to reliability.
• All bug fixes in v2.0 will be backported to the v1.x branch.
• Fix for a bug where on older laptops, older browsers, and on systems with unusually high security restrictions the product was unusable.

v1.5 (released Dec 1st 2020)

• Added folder functionality in the list page. Default folders include all lists and favourites. The top 10 most recent lists will be displayed at the top of the page.
• Added keyword filtering functionality to the insights page, including number of companies considered after filtering.
• Improved the algorithm for assigning a company’s financial year to a calendar year for aligned financial estimates. January 2020 results are assigned to calendar year 2019.
• Fix for a known bug where under rare circumstances a CSV download may be malformed.
• Improved UI so that users who over-define a training set with included companies are prompted to add negatives and avoided the list being lost and requiring support.
• Stronger separation between staging/alpha and live/beta environments.
• Increase in server uptime. We are currently at >99.5% uptime for 2020 with zero lost data. But the <0.5% of time when our service is down is during peak load when our users most need the service.

v1.2 (released — Dec. 2020)

• Insights 1.9 released. This consists of financial projections for a given list and identifying the top 10 companies per financial field.
• The Data City does not include financial predictions for singular companies however the insights page will forecast company financials for a given sector. Should a company include a financial field for the previous year but not the current year, the same value from the previous year is used for the current year. This assumes a normal trading year.
• x2 speed improvements to list building.
• Added the ability to report a missing website for a company.
• Added the ability to report a mismatched website for a company.

v1.1 (released — Nov. 2020)

• Added Country of Origin into the locations filter.
• Added ‘Always include companies present in training set’ option to the keyword filter. This ensures a user will not miss out on companies they have manually included into their list (through the training set).
• Added Company Category into the sector filter
• Added column view of finances to CSV format download of lists.
• ‘In training set’ column added to the list download.

v1.0 (released — Oct. 2020)

• 830,000 businesses with matched websites.
• Significant UI improvements (links, back button, multiple tabs, etc…)
• Expansion of financial data to cover up to the past five years of trading. Financial records for nearly 100% of companies including turnover, profit, assets and liabilities.
• Broader coverage of employee number estimates.
• Complex keyword adding to the list-building UI to accelerate list creation and training set refinement.
• “My Words” feature added.
• “Find a company” feature added.
• Added list copying.
• Improved server stability.
• Historical director data added to the explorer.

v0.5 (released — Sep. 2020)

• 300,000 website matches added leaving 830,000 companies will full website details.
• 64,000 false positive website matches removed.
• X60 speed improvement to whole-website keyword filtering. From five minutes to five seconds.
• Fixed duplicate financial data for companies filing their accounts twice in one year.
• Expansion of all features of the product to Northern Ireland.
• Classifier terms added to the CSV download feature (now served a single .zip).
• Directors added to the CSV download feature (now served a single .zip).
• Company incorporation date added as a field.

v0.4 (released — Mar. 2020)

• Data download updated to include financial data.
• Three years of financial data expanded to cover 75% of businesses.
• CSV format download of lists (row view of finances)
• Included company descriptions available. These are more detailed than those included on company accounts and more accurately reflect the company’s primary IP.
• Classifier explanation (terms) included and added to the list building page. Opening these up will help the user know keywords being prioritised to build the list.

v0.3 (released — Feb. 2020)

• Added three years of financial data for >50% of companies.
• Copy and paste enabled on training set fields.
• Expanded company details page for each company.
• 600,000 website screenshots added.
• Insights v1.0 included. Each list is now able to be visualised. Graphical outputs will be produced which include SIC code breakdowns and locational data.
• Current company officers and directors added to company details.

v0.2 (released — Dec. 2019)

• Autosave for lists.
• Added “share lists”.

v0.1 (released — Nov 2019)

• Added Phone, Email, LinkedIn, Facebook, Instagram, YouTube and Twitter to company descriptions.

v0.1a (released — Oct 2019)

• 600,000 companies with websites.
• User-defined classifier to define lists.
• Company details from Companies House.