Skip to content

Commit 3f054bb

Browse files
MaxGhenisMaxGhenis
committed
Merge remote-tracking branch 'origin/main' into codex/ledger-rename-boundary-20260630
# Conflicts: # tests/test_ledger_source_cells.py
2 parents add0017 + ac643af commit 3f054bb

20 files changed

Lines changed: 49054 additions & 2 deletions

File tree

‎db/data/hmrc/vat_firm_sector_targets_2024_25/hmrc_vat_firm_sector_targets_2024_25.csv‎

Lines changed: 177 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,177 @@
1+
target_group,sector_id,sector_label,value
2+
vat_registered_count_by_sic,00001,"Crop and animal production, hunting and related service activities",128900
3+
vat_registered_count_by_sic,00002,Forestry and logging,5480
4+
vat_registered_count_by_sic,00003,Fishing and aquaculture,4540
5+
vat_registered_count_by_sic,00005,Mining of coal and lignite,30
6+
vat_registered_count_by_sic,00006,Extraction of crude petroleum and natural gas,220
7+
vat_registered_count_by_sic,00007,Mining of metal ores,90
8+
vat_registered_count_by_sic,00008,Other mining and quarrying,790
9+
vat_registered_count_by_sic,00009,Mining and support service activities,1470
10+
vat_registered_count_by_sic,00010,Manufacture of food products,10200
11+
vat_registered_count_by_sic,00011,Manufacture of beverages,3230
12+
vat_registered_count_by_sic,00012,Manufacture of tobacco products,60
13+
vat_registered_count_by_sic,00013,Manufacture of textiles,4170
14+
vat_registered_count_by_sic,00014,Manufacture of wearing apparel,3450
15+
vat_registered_count_by_sic,00015,Manufacture of leather and related products,820
16+
vat_registered_count_by_sic,00016,"Manufacture of wood and of products of wood and cork, except furniture; manufacture of articles of straw and plaiting materials",8240
17+
vat_registered_count_by_sic,00017,Manufacture of paper and paper products,1610
18+
vat_registered_count_by_sic,00018,Printing and reproduction of recorded media,9630
19+
vat_registered_count_by_sic,00019,Manufacture of coke and refined petroleum products,180
20+
vat_registered_count_by_sic,00020,Manufacture of chemicals and chemical products,3680
21+
vat_registered_count_by_sic,00021,Manufacture of basic pharmaceutical products and pharmaceutical preparations,840
22+
vat_registered_count_by_sic,00022,Manufacture of rubber and rubber products,4730
23+
vat_registered_count_by_sic,00023,Manufacture of other non-metallic mineral products,4420
24+
vat_registered_count_by_sic,00024,Manufacture of basic metals,2350
25+
vat_registered_count_by_sic,00025,"Manufacture of fabricated metal products, except machinery and equipment",19300
26+
vat_registered_count_by_sic,00026,"Manufacture of computer, electronic and optical products",5900
27+
vat_registered_count_by_sic,00027,Manufacture of electrical equipment,2900
28+
vat_registered_count_by_sic,00028,Manufacture of machinery and equipment n.e.c,7710
29+
vat_registered_count_by_sic,00029,"Manufacture of motor vehicles, trailers and semi-trailers",3100
30+
vat_registered_count_by_sic,00030,Manufacture of other transport equipment,2040
31+
vat_registered_count_by_sic,00031,Manufacture of furniture,5720
32+
vat_registered_count_by_sic,00032,Other manufacturing,10400
33+
vat_registered_count_by_sic,00033,Repair and installation of machinery and equipment,13500
34+
vat_registered_count_by_sic,00035,"Electricity, gas, steam and air conditioning supply",7530
35+
vat_registered_count_by_sic,00036,"Water collection, treatment and supply",650
36+
vat_registered_count_by_sic,00037,Sewerage,920
37+
vat_registered_count_by_sic,00038,"Waste collection, treatment and disposal activities; materials recovery",5240
38+
vat_registered_count_by_sic,00039,Remediation activities and other waste management services,1260
39+
vat_registered_count_by_sic,00041,Construction of buildings,117600
40+
vat_registered_count_by_sic,00042,Civil engineering,22300
41+
vat_registered_count_by_sic,00043,Specialised construction activities,209800
42+
vat_registered_count_by_sic,00045,Wholesale and retail trade and repair of motor vehicles and motorcycles,71400
43+
vat_registered_count_by_sic,00046,"Wholesale trade, except of motor vehicles and motorcycles",104400
44+
vat_registered_count_by_sic,00047,Retail trade except of motor vehicles and motorcycles,335600
45+
vat_registered_count_by_sic,00049,Land transport and transport via pipelines,50400
46+
vat_registered_count_by_sic,00050,Water transport,1530
47+
vat_registered_count_by_sic,00051,Air transport,1170
48+
vat_registered_count_by_sic,00052,Warehousing and support activities for transportation,12300
49+
vat_registered_count_by_sic,00053,Postal and courier activities,33200
50+
vat_registered_count_by_sic,00055,Accommodation,18000
51+
vat_registered_count_by_sic,00056,Food and beverage service activities,110400
52+
vat_registered_count_by_sic,00058,Publishing activities,11900
53+
vat_registered_count_by_sic,00059,"Motion picture, video and television programme production, sound recording and music publishing activities",30900
54+
vat_registered_count_by_sic,00060,Programming and broadcasting activities,1470
55+
vat_registered_count_by_sic,00061,Telecommunications,6900
56+
vat_registered_count_by_sic,00062,"Computer programming, consultancy and related activities",118800
57+
vat_registered_count_by_sic,00063,Information service activities,7040
58+
vat_registered_count_by_sic,00064,"Financial service activities, except insurance and pension funding",14000
59+
vat_registered_count_by_sic,00065,"Insurance, reinsurance and pension funding, except compulsory social security",2970
60+
vat_registered_count_by_sic,00066,Activities auxiliary to financial services and insurance activities,6240
61+
vat_registered_count_by_sic,00068,Real estate activities,112800
62+
vat_registered_count_by_sic,00069,Legal and accounting services,58700
63+
vat_registered_count_by_sic,00070,Activities of head offices; management consultancy services,136100
64+
vat_registered_count_by_sic,00071,Architectural and engineering activities; technical testing and analysis,63900
65+
vat_registered_count_by_sic,00072,Scientific research and development,5800
66+
vat_registered_count_by_sic,00073,Advertising and market research,20000
67+
vat_registered_count_by_sic,00074,"Other professional, scientific and technical activities",48100
68+
vat_registered_count_by_sic,00075,Veterinary activities,3680
69+
vat_registered_count_by_sic,00077,Rental and leasing activities,18200
70+
vat_registered_count_by_sic,00078,Employment activities,25500
71+
vat_registered_count_by_sic,00079,"Travel agency, tour operator and other reservation service and related activities",7320
72+
vat_registered_count_by_sic,00080,Security and investigation activities,8690
73+
vat_registered_count_by_sic,00081,Services to buildings and landscape activities,37700
74+
vat_registered_count_by_sic,00082,Office administrative and support activities,48700
75+
vat_registered_count_by_sic,00084,Public administration and defence; compulsory social security,3760
76+
vat_registered_count_by_sic,00085,Education,23600
77+
vat_registered_count_by_sic,00086,Human health activities,10300
78+
vat_registered_count_by_sic,00087,Residential care activities,1820
79+
vat_registered_count_by_sic,00088,Social work activities without accommodation,3160
80+
vat_registered_count_by_sic,00090,"Creative, arts and entertainment activities",28800
81+
vat_registered_count_by_sic,00091,"Libraries, archives, museums and other cultural activities",1120
82+
vat_registered_count_by_sic,00092,Gambling and betting activities,360
83+
vat_registered_count_by_sic,00093,Sports activities and amusement and recreation activities,33400
84+
vat_registered_count_by_sic,00094,Activities of membership organisations,8610
85+
vat_registered_count_by_sic,00095,Repair of computers and personal and household goods,4860
86+
vat_registered_count_by_sic,00096,Other personal service activities,41300
87+
vat_registered_count_by_sic,00097,Activities of households as employers of domestic personnel,140
88+
vat_registered_count_by_sic,00098,Undifferentiated goods- and services-producing activities of private households for own use,130
89+
vat_registered_count_by_sic,00099,Activities of extraterritorial organisations and bodies,60
90+
vat_liability_by_sic,00001,"Crop and animal production, hunting and related service activities",-2300.0
91+
vat_liability_by_sic,00002,Forestry and logging,110.0
92+
vat_liability_by_sic,00003,Fishing and aquaculture,-100.0
93+
vat_liability_by_sic,00005,Mining of coal and lignite,0.0
94+
vat_liability_by_sic,00006,Extraction of crude petroleum and natural gas,-460.0
95+
vat_liability_by_sic,00007,Mining of metal ores,-10.0
96+
vat_liability_by_sic,00008,Other mining and quarrying,290.0
97+
vat_liability_by_sic,00009,Mining and support service activities,-320.0
98+
vat_liability_by_sic,00010,Manufacture of food products,-2060.0
99+
vat_liability_by_sic,00011,Manufacture of beverages,1840.0
100+
vat_liability_by_sic,00012,Manufacture of tobacco products,1700.0
101+
vat_liability_by_sic,00013,Manufacture of textiles,440.0
102+
vat_liability_by_sic,00014,Manufacture of wearing apparel,290.0
103+
vat_liability_by_sic,00015,Manufacture of leather and related products,130.0
104+
vat_liability_by_sic,00016,"Manufacture of wood and of products of wood and cork, except furniture; manufacture of articles of straw and plaiting materials",620.0
105+
vat_liability_by_sic,00017,Manufacture of paper and paper products,870.0
106+
vat_liability_by_sic,00018,Printing and reproduction of recorded media,500.0
107+
vat_liability_by_sic,00019,Manufacture of coke and refined petroleum products,7550.0
108+
vat_liability_by_sic,00020,Manufacture of chemicals and chemical products,1570.0
109+
vat_liability_by_sic,00021,Manufacture of basic pharmaceutical products and pharmaceutical preparations,600.0
110+
vat_liability_by_sic,00022,Manufacture of rubber and rubber products,1470.0
111+
vat_liability_by_sic,00023,Manufacture of other non-metallic mineral products,1150.0
112+
vat_liability_by_sic,00024,Manufacture of basic metals,-780.0
113+
vat_liability_by_sic,00025,"Manufacture of fabricated metal products, except machinery and equipment",1990.0
114+
vat_liability_by_sic,00026,"Manufacture of computer, electronic and optical products",1130.0
115+
vat_liability_by_sic,00027,Manufacture of electrical equipment,840.0
116+
vat_liability_by_sic,00028,Manufacture of machinery and equipment n.e.c,1320.0
117+
vat_liability_by_sic,00029,"Manufacture of motor vehicles, trailers and semi-trailers",1390.0
118+
vat_liability_by_sic,00030,Manufacture of other transport equipment,-1250.0
119+
vat_liability_by_sic,00031,Manufacture of furniture,720.0
120+
vat_liability_by_sic,00032,Other manufacturing,1200.0
121+
vat_liability_by_sic,00033,Repair and installation of machinery and equipment,1050.0
122+
vat_liability_by_sic,00035,"Electricity, gas, steam and air conditioning supply",3940.0
123+
vat_liability_by_sic,00036,"Water collection, treatment and supply",-2490.0
124+
vat_liability_by_sic,00037,Sewerage,-10.0
125+
vat_liability_by_sic,00038,"Waste collection, treatment and disposal activities; materials recovery",600.0
126+
vat_liability_by_sic,00039,Remediation activities and other waste management services,350.0
127+
vat_liability_by_sic,00041,Construction of buildings,2630.0
128+
vat_liability_by_sic,00042,Civil engineering,4490.0
129+
vat_liability_by_sic,00043,Specialised construction activities,5000.0
130+
vat_liability_by_sic,00045,Wholesale and retail trade and repair of motor vehicles and motorcycles,14000.0
131+
vat_liability_by_sic,00046,"Wholesale trade, except of motor vehicles and motorcycles",25900.0
132+
vat_liability_by_sic,00047,Retail trade except of motor vehicles and motorcycles,16800.0
133+
vat_liability_by_sic,00049,Land transport and transport via pipelines,-310.0
134+
vat_liability_by_sic,00050,Water transport,-90.0
135+
vat_liability_by_sic,00051,Air transport,-1340.0
136+
vat_liability_by_sic,00052,Warehousing and support activities for transportation,1190.0
137+
vat_liability_by_sic,00053,Postal and courier activities,1250.0
138+
vat_liability_by_sic,00055,Accommodation,2860.0
139+
vat_liability_by_sic,00056,Food and beverage service activities,8800.0
140+
vat_liability_by_sic,00058,Publishing activities,800.0
141+
vat_liability_by_sic,00059,"Motion picture, video and television programme production, sound recording and music publishing activities",470.0
142+
vat_liability_by_sic,00060,Programming and broadcasting activities,-20.0
143+
vat_liability_by_sic,00061,Telecommunications,4250.0
144+
vat_liability_by_sic,00062,"Computer programming, consultancy and related activities",15700.0
145+
vat_liability_by_sic,00063,Information service activities,430.0
146+
vat_liability_by_sic,00064,"Financial service activities, except insurance and pension funding",90.0
147+
vat_liability_by_sic,00065,"Insurance, reinsurance and pension funding, except compulsory social security",290.0
148+
vat_liability_by_sic,00066,Activities auxiliary to financial services and insurance activities,1060.0
149+
vat_liability_by_sic,00068,Real estate activities,4840.0
150+
vat_liability_by_sic,00069,Legal and accounting services,9590.0
151+
vat_liability_by_sic,00070,Activities of head offices; management consultancy services,9410.0
152+
vat_liability_by_sic,00071,Architectural and engineering activities; technical testing and analysis,5080.0
153+
vat_liability_by_sic,00072,Scientific research and development,30.0
154+
vat_liability_by_sic,00073,Advertising and market research,2010.0
155+
vat_liability_by_sic,00074,"Other professional, scientific and technical activities",1710.0
156+
vat_liability_by_sic,00075,Veterinary activities,810.0
157+
vat_liability_by_sic,00077,Rental and leasing activities,1690.0
158+
vat_liability_by_sic,00078,Employment activities,5870.0
159+
vat_liability_by_sic,00079,"Travel agency, tour operator and other reservation service and related activities",170.0
160+
vat_liability_by_sic,00080,Security and investigation activities,1160.0
161+
vat_liability_by_sic,00081,Services to buildings and landscape activities,2500.0
162+
vat_liability_by_sic,00082,Office administrative and support activities,6250.0
163+
vat_liability_by_sic,00084,Public administration and defence; compulsory social security,-11600.0
164+
vat_liability_by_sic,00085,Education,960.0
165+
vat_liability_by_sic,00086,Human health activities,40.0
166+
vat_liability_by_sic,00087,Residential care activities,320.0
167+
vat_liability_by_sic,00088,Social work activities without accommodation,420.0
168+
vat_liability_by_sic,00090,"Creative, arts and entertainment activities",1750.0
169+
vat_liability_by_sic,00091,"Libraries, archives, museums and other cultural activities",30.0
170+
vat_liability_by_sic,00092,Gambling and betting activities,70.0
171+
vat_liability_by_sic,00093,Sports activities and amusement and recreation activities,1910.0
172+
vat_liability_by_sic,00094,Activities of membership organisations,590.0
173+
vat_liability_by_sic,00095,Repair of computers and personal and household goods,300.0
174+
vat_liability_by_sic,00096,Other personal service activities,3210.0
175+
vat_liability_by_sic,00097,Activities of households as employers of domestic personnel,0.0
176+
vat_liability_by_sic,00098,Undifferentiated goods- and services-producing activities of private households for own use,0.0
177+
vat_liability_by_sic,00099,Activities of extraterritorial organisations and bodies,40.0

‎db/data/hmrc/vat_firm_sector_targets_2024_25/manifest.yaml‎

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
source_id: hmrc-vat-firm-sector-targets-2024-25
2+
source_name: HMRC Annual UK VAT Statistics 2024 to 2025
3+
publisher: HM Revenue and Customs
4+
source_page: https://www.gov.uk/government/statistics/value-added-tax-vat-annual-statistics
5+
files:
6+
2024:
7+
filename: hmrc_vat_firm_sector_targets_2024_25.csv
8+
source_url: https://www.gov.uk/government/statistics/value-added-tax-vat-annual-statistics
9+
source_table: Annual UK VAT Statistics 2024 to 2025 VAT trader population and net VAT
10+
liability by trade sector
11+
sha256: 508d96cc162daf60ce65efe87b496a59611b5443638a1ab5dc7113a832f6067a
12+
size_bytes: 14230
13+
storage:
14+
r2:
15+
provider: r2
16+
bucket: arch-raw
17+
key: raw/hmrc/hmrc-vat-firm-sector-targets-2024-25/2024/508d96cc162daf60ce65efe87b496a59611b5443638a1ab5dc7113a832f6067a/hmrc_vat_firm_sector_targets_2024_25.csv
18+
uri: r2://arch-raw/raw/hmrc/hmrc-vat-firm-sector-targets-2024-25/2024/508d96cc162daf60ce65efe87b496a59611b5443638a1ab5dc7113a832f6067a/hmrc_vat_firm_sector_targets_2024_25.csv
19+
source_urls:
20+
- https://www.gov.uk/government/statistics/value-added-tax-vat-annual-statistics
21+
notes: Curated trade-sector extract from HMRC Annual UK VAT Statistics 2024 to 2025 used
22+
by firm-microsim-paper processed/2024-25.

‎db/data/hmrc/vat_firm_targets_2024_25/hmrc_vat_firm_targets_2024_25.csv‎

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
target_group,band_id,band_label,value
2+
vat_registered_count_by_turnover,negative_or_zero,"Negative or zero annual turnover",211400
3+
vat_registered_count_by_turnover,1_to_threshold,"GBP 1 to VAT registration threshold annual turnover",683700
4+
vat_registered_count_by_turnover,threshold_to_150k,"VAT registration threshold to GBP 150,000 annual turnover",280400
5+
vat_registered_count_by_turnover,150k_to_300k,"GBP 150,000 to GBP 300,000 annual turnover",338600
6+
vat_registered_count_by_turnover,300k_to_500k,"GBP 300,000 to GBP 500,000 annual turnover",186700
7+
vat_registered_count_by_turnover,500k_to_1m,"GBP 500,000 to GBP 1,000,000 annual turnover",184100
8+
vat_registered_count_by_turnover,1m_to_10m,"GBP 1,000,000 to GBP 10,000,000 annual turnover",240500
9+
vat_registered_count_by_turnover,greater_than_10m,"Greater than GBP 10,000,000 annual turnover",45800
10+
vat_registered_count_by_turnover,unknown,"Unknown annual turnover",159300
11+
vat_liability_by_turnover,negative_or_zero,"Negative or zero annual turnover",-2910
12+
vat_liability_by_turnover,1_to_threshold,"GBP 1 to VAT registration threshold annual turnover",-300
13+
vat_liability_by_turnover,threshold_to_150k,"VAT registration threshold to GBP 150,000 annual turnover",2420
14+
vat_liability_by_turnover,150k_to_300k,"GBP 150,000 to GBP 300,000 annual turnover",4830
15+
vat_liability_by_turnover,300k_to_500k,"GBP 300,000 to GBP 500,000 annual turnover",3970
16+
vat_liability_by_turnover,500k_to_1m,"GBP 500,000 to GBP 1,000,000 annual turnover",6840
17+
vat_liability_by_turnover,1m_to_10m,"GBP 1,000,000 to GBP 10,000,000 annual turnover",29520
18+
vat_liability_by_turnover,greater_than_10m,"Greater than GBP 10,000,000 annual turnover",132800

‎db/data/hmrc/vat_firm_targets_2024_25/manifest.yaml‎

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
source_id: hmrc-vat-firm-targets-2024-25
2+
source_name: HMRC Annual UK VAT Statistics 2024 to 2025
3+
publisher: HM Revenue and Customs
4+
source_page: https://www.gov.uk/government/statistics/value-added-tax-vat-annual-statistics
5+
files:
6+
2024:
7+
filename: hmrc_vat_firm_targets_2024_25.csv
8+
source_url: https://www.gov.uk/government/statistics/value-added-tax-vat-annual-statistics
9+
source_table: Annual UK VAT Statistics 2024 to 2025 VAT trader population and net VAT liability by turnover band
10+
sha256: 8bea6fdc9a5e397950fbc5bc58b6f26586e02ff76622b21b949592520a7d6d79
11+
size_bytes: 1675
12+
storage:
13+
r2:
14+
provider: r2
15+
bucket: arch-raw
16+
key: raw/hmrc/hmrc-vat-firm-targets-2024-25/2024/8bea6fdc9a5e397950fbc5bc58b6f26586e02ff76622b21b949592520a7d6d79/hmrc_vat_firm_targets_2024_25.csv
17+
uri: r2://arch-raw/raw/hmrc/hmrc-vat-firm-targets-2024-25/2024/8bea6fdc9a5e397950fbc5bc58b6f26586e02ff76622b21b949592520a7d6d79/hmrc_vat_firm_targets_2024_25.csv
18+
source_urls:
19+
- https://www.gov.uk/government/statistics/value-added-tax-vat-annual-statistics
20+
notes: >-
21+
Curated national extract from HMRC Annual UK VAT Statistics 2024 to 2025.
22+
Net VAT liability rows retain source values in GBP millions and are scaled
23+
to GBP by the Ledger source package.

‎db/data/ons/uk_business_firm_sector_targets_2025/manifest.yaml‎

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
source_id: ons-uk-business-firm-sector-targets-2025
2+
source_name: ONS UK Business, Activity, Size and Location 2025
3+
publisher: Office for National Statistics
4+
source_page: https://www.ons.gov.uk/businessindustryandtrade/business/activitysizeandlocation/datasets/ukbusinessactivitysizeandlocation
5+
files:
6+
2025:
7+
filename: ons_uk_business_firm_sector_targets_2025.csv
8+
source_url: https://www.ons.gov.uk/businessindustryandtrade/business/activitysizeandlocation/datasets/ukbusinessactivitysizeandlocation
9+
source_table: UK Business, Activity, Size and Location 2025 enterprise counts by SIC division,
10+
turnover band, and employment size band
11+
sha256: b61951d78220f6da081dd3a2396cee3f1add2d21e9cf40e89c446f25f1d05b46
12+
size_bytes: 162936
13+
storage:
14+
r2:
15+
provider: r2
16+
bucket: arch-raw
17+
key: raw/ons/ons-uk-business-firm-sector-targets-2025/2025/b61951d78220f6da081dd3a2396cee3f1add2d21e9cf40e89c446f25f1d05b46/ons_uk_business_firm_sector_targets_2025.csv
18+
uri: r2://arch-raw/raw/ons/ons-uk-business-firm-sector-targets-2025/2025/b61951d78220f6da081dd3a2396cee3f1add2d21e9cf40e89c446f25f1d05b46/ons_uk_business_firm_sector_targets_2025.csv
19+
source_urls:
20+
- https://www.ons.gov.uk/businessindustryandtrade/business/activitysizeandlocation/datasets/ukbusinessactivitysizeandlocation
21+
notes: Curated sector-by-band extract from the ONS UK Business 2025 workbook used by firm-microsim-paper
22+
processed/2024-25.

0 commit comments

Comments
 (0)