Quantity and Weight information in UN Comtrade
Quantity and Weight information in UN Comtrade
Quantity and Weight information in UN Comtrade
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Quantity</strong> <strong>and</strong> <strong>Weight</strong> <strong><strong>in</strong>formation</strong> <strong>in</strong> <strong>UN</strong> <strong>Comtrade</strong><br />
Introduction of a new system<br />
1<br />
Initial draft as of May 2008<br />
A new system of provid<strong>in</strong>g <strong><strong>in</strong>formation</strong> on supplementary quantity <strong>and</strong> net weight has been<br />
<strong>in</strong>troduced start<strong>in</strong>g 1.1.2006 with the implementation of a new process<strong>in</strong>g system. This new<br />
system has three core elements:<br />
1. <strong>Quantity</strong> <strong>and</strong> weight <strong><strong>in</strong>formation</strong> are accommodated <strong>in</strong> two separate data fields which allows<br />
to have <strong><strong>in</strong>formation</strong> on the supplementary quantity <strong>and</strong> net weight at the same time. This is <strong>in</strong><br />
l<strong>in</strong>e with the <strong>in</strong>ternational recommendation to compile the supplementary quantity <strong>and</strong> <strong>in</strong><br />
addition net weight where appropriate (IMTS, Rev.2, para. 133).<br />
2. For the supplementary quantity the recommended quantity units of the World Customs<br />
Organization (WCO RU) are enforced <strong>in</strong> order to allow comparability across countries. This<br />
means that the quantity <strong><strong>in</strong>formation</strong> reported for a particular commodity has to be reported <strong>in</strong> a<br />
WCO RU or it must be possible to convert it <strong>in</strong>to a WCO RU. Otherwise the quantity<br />
<strong><strong>in</strong>formation</strong> is disregarded.<br />
3. Any miss<strong>in</strong>g quantity or net weight <strong><strong>in</strong>formation</strong> <strong>and</strong> disregarded quantity <strong><strong>in</strong>formation</strong> is<br />
estimated (to the extend that such an estimation is possible). In addition, for a limited number of<br />
records per country extreme values for quantity <strong>and</strong> net weight are replaced with estimated<br />
values (see Annex 1 for details).<br />
The previous process<strong>in</strong>g system was able to accommodate only either net weight or<br />
supplementary quantity <strong>in</strong> case both were provided. Also there was no procedure to ensure that<br />
the quantity <strong><strong>in</strong>formation</strong> for <strong>in</strong>dividual commodities would follow a specific quantity unit.<br />
The new system came <strong>in</strong>to force 1.1.2006 <strong>and</strong> all data with the report<strong>in</strong>g year 2005 <strong>and</strong> later has<br />
been processed us<strong>in</strong>g this new system. Yet, <strong>UN</strong>SD is also reprocess<strong>in</strong>g data back to the year<br />
2000 with the goal to provide all data start<strong>in</strong>g with the report<strong>in</strong>g year 2000 accord<strong>in</strong>g to this new<br />
process<strong>in</strong>g st<strong>and</strong>ard.<br />
Best possible use of <strong><strong>in</strong>formation</strong> provided<br />
Estimation of quantity <strong>and</strong> net weight are only the last resort. The follow<strong>in</strong>g steps are undertaken<br />
to make the best possible use of the <strong><strong>in</strong>formation</strong> provided by the country:<br />
a) Net weight is copied <strong>in</strong>to the supplementary unit <strong>and</strong> vice versa <strong>in</strong> all cases where only<br />
one of them is reported.<br />
b) Dur<strong>in</strong>g code normalization conversion factors are used to convert supplementary<br />
quantities reported <strong>in</strong> non-st<strong>and</strong>ard quantity units <strong>in</strong>to quantities of WCO st<strong>and</strong>ard units.<br />
Such conversion factors can be mathematical or empirical. Countries are requested to<br />
establish <strong>and</strong> provide a comprehensive list of such conversion factors.<br />
c) There is also an automatic conversion us<strong>in</strong>g conversion factors provided by FAO.<br />
d) In addition, there is also a automatic conversion of Number(5) to/from Thous<strong>and</strong>s (9);<br />
Number(5) to/from Dozen (11); Kg (8) to/from Carat <strong>and</strong> Liter (7) to/from meter cubic<br />
(12)
2<br />
Initial draft as of May 2008<br />
Estimation methodology<br />
Estimation of quantity <strong>and</strong> net weight is performed <strong>in</strong> three cases: a) Data has not been provided;<br />
b) Provided data is disregarded as it does not conform with <strong>and</strong> cannot be converted <strong>in</strong>to WCO<br />
RU <strong>and</strong> c) <strong>Quantity</strong> or net weight provided is extreme. There are two estimation procedures:<br />
1. Us<strong>in</strong>g partly reported quantity <strong>and</strong>/or net weight <strong>in</strong> the same commodity/unit/flow<br />
(<strong>Weight</strong>ed Unit Value):<br />
In order to use the partly reported quantity <strong>and</strong>/or net weight to be used to estimate non-reported<br />
quantity <strong>and</strong>/or net weight, it has to pass the confidence threshold. For OECD countries, the trade<br />
value share of partly reported quantity <strong>and</strong>/or net weight must be more than 20%, <strong>and</strong> for non-<br />
OECD countries must be more than 50%.<br />
2. Us<strong>in</strong>g St<strong>and</strong>ard Unit Value (SUV)<br />
St<strong>and</strong>ard Unit Value (SUV) is used to estimate net weight <strong>and</strong> quantity whenever <strong>Weight</strong>ed Unit<br />
Value is not available. SUV was calculated at the end of the year <strong>and</strong> are used for quantity <strong>and</strong>/or<br />
net weight estimation or outliers detection. Please refer to SUV methodology for detailed<br />
<strong><strong>in</strong>formation</strong>.<br />
Documentation of estimations<br />
1. Estimation Flag available on <strong>UN</strong> <strong>Comtrade</strong><br />
Estimated records are clearly identified by an estimation flag <strong>and</strong> are shown <strong>in</strong> italics (at result<br />
page). By default, the estimation flag is part of download format.<br />
The estimation flag possible values are:<br />
0 = no estimation<br />
2 = quantity estimation only<br />
4 = netweight estimation only<br />
6 = both quantity <strong>and</strong> netweight are estimated.<br />
2. Footnotes are generated describ<strong>in</strong>g the estimation procedure used.<br />
The footnotes can be downloaded separately from the data records. Please note that one record<br />
can have more than one footnote. The follow<strong>in</strong>g footnotes are provided:<br />
In case of miss<strong>in</strong>g net weight quantity<br />
1) Net weight estimated us<strong>in</strong>g St<strong>and</strong>ard Unit Value<br />
2) Net weight estimated us<strong>in</strong>g <strong>Weight</strong>ed Unit Value<br />
3) Supp Qty estimated us<strong>in</strong>g St<strong>and</strong>ard Unit Value<br />
4) Supp Qty estimated us<strong>in</strong>g <strong>Weight</strong>ed Unit Value<br />
In case of extreme quantity <strong>and</strong> net weight<br />
5) SUV applied for weight. Orig<strong>in</strong>al UV: [ ]<br />
6) SUV applied. Orig<strong>in</strong>al UV: [ ]<br />
In addition:<br />
7) Supp Qty Unit set to ‘No <strong>Quantity</strong>’ because SUV is not available
Annex I: Extremes Unit Values Criteria<br />
For both quantity unit <strong>and</strong> net weight <strong>and</strong> partner World, there are three checks:<br />
1. Historical Unit Value Check<br />
Unit Values are considered extreme if ():<br />
- Value is more than 0.005% of Totals<br />
- Unit Value is more than maximum of historical unit value * 10<br />
- Unit Value is less than m<strong>in</strong>imum of historical unit value / 10<br />
2. St<strong>and</strong>ard Unit Value Check<br />
Unit Values are considered extreme if ():<br />
- Value is more than $50,000<br />
- Unit Value is more than upper limit of st<strong>and</strong>ard unit value * 2<br />
- Unit Value is more than upper limit of st<strong>and</strong>ard unit value / 2<br />
3. Historical Value Check<br />
Values are considered extreme if:<br />
- Value is more than $1,000,000<br />
- Value is more than maximum of historical value * 100<br />
- Value is less than m<strong>in</strong>imum of historical value / 100<br />
3<br />
Initial draft as of May 2008<br />
Not all extremes unit values are corrected, only 5% of them (because the checks are done only<br />
with partner world, the 5% only applies to comb<strong>in</strong>ation of commodity – trade flow).<br />
Then the ratios of unit values are calculated to determ<strong>in</strong>e the sort<strong>in</strong>g order:<br />
If unit value < m<strong>in</strong>imum unit value then ratio = m<strong>in</strong>imum unit value / unit value<br />
Otherwise ratio = unit value / maximum of unit value<br />
The top 5% ratios will be corrected by apply<strong>in</strong>g st<strong>and</strong>ard unit value for all partners.