{"id":7243,"date":"2025-12-09T16:19:59","date_gmt":"2025-12-09T22:19:59","guid":{"rendered":"https:\/\/librarytestdev.wpenginepowered.com\/?post_type=doc&#038;p=7243"},"modified":"2026-01-23T12:52:46","modified_gmt":"2026-01-23T18:52:46","slug":"importing-data-using-tt-data-file-upload","status":"publish","type":"doc","link":"https:\/\/library-staging.tradingtechnologies.com\/tt-trade-surveillance\/reference-tt-trade-surveillance\/importing-data-using-tt-data-file-upload\/","title":{"rendered":"Importing data using TT Data File Upload"},"content":{"rendered":"\n<section>\n    <h2 id=\"Overview\">Overview<\/h2>\n    <p>TT Trade Surveillance offers the ability to upload data via a .csv file. This allows users to easily add and process data into\n        TT Trade Surveillance. The TT Trade Surveillance File upload uses the same file upload method that TT uses for uploading credit, start of\n        day, and product margin files.<\/p>\n\n    <h2 id=\"Prerequisites\">Prerequisites<\/h2>\n\n    <p>Prior to uploading files:<\/p>\n    <ul>\n        <li>You must configure connection access for file uploads. Refer to the <a href=\"\/user-setup\/rm-data-file-uploads.html#configuring-access\">Configuring\n                Access for File Uploads<\/a> section in the Setup help for more details.<\/li>\n\n        <li>Each company must have at least 1 account with <b>Type<\/b> set to <b>Audit Trail Only<\/b>. Refer to <a href=\"\/user-setup\/ac-creating-a-new-account.html\">Creating a New Account<\/a> in the Setup help for more details.<\/li>\n    <\/ul>\n\n    <h2 id=\"supported-formats\">Supported Formats<\/h2>\n\n    <p>To support this functionality, you must ensure the columns and rows in your .csv file matches one of the\n        following formats:<\/p>\n\n    <ul>\n        <li>\n            <b>Generic Audit Trail File<\/b>: TT&#8217;s custom format. When importing data from any external source, you\n            must ensure the file contents match the correctly mapped Generic Audit Trail File. For your convenience,\n            you can <a href=\"https:\/\/library-staging.tradingtechnologies.com\/wp-content\/uploads\/2026\/01\/tt_trade_surveillance_file_mapping.csv\">download a sample mapping file here<\/a>.\n        <\/li>\n        <br>\n\n        <li>\n            <b>Trayport Format<\/b>: TT Trade Surveillance supports .csv files exported directly from the Trayport application. For more information on Trayport, refer to the <b>Trayport\u2019s Daily Market Activity File\n                Guide<\/b> available on their website.\n            <p><\/p>\n            <p><span class=\"label-info label\">Note<\/span> If all of the trader fields (Trader, InitiatorTraderName, AggressorTraderName) are set to empty, those records will be treated as non-customer data and filtered out of Trade Surveillance processing. Also, if one of the trader fields is set to <b>System Anonymous Trader<\/b>, it will be filtered out of Trade Surveillance processing.<\/p>\n        <\/li>\n    <\/ul>\n\n<\/section>\n\n<section>\n    <h2 id=\"uploading-file\">Uploading a File<\/h2>\n\n    <p>TT offers two methods to upload data files into the platform: <a href=\"\/user-setup\/rm-data-file-uploads.html\">Data File Upload and\n            Auto Upload<\/a>. Both methods are available in the <b>Company Settings<\/b> section of the Setup application.\n    <\/p>\n\n    <ul>\n        <li>\n            <p><b>Data File Upload<\/b>: This method allows direct upload of a single data file.<\/p>\n            <p><span class=\"label-info label\">Note<\/span> The Data File Upload method has a 10mb file size limit. If\n                uploading larger amounts of data, TT recommends using the Auto Upload feature.<\/p>\n        <\/li>\n        <li>\n            <p><b>Auto Upload<\/b>: This method allows scheduled, automatic daily file uploads and supports files larger\n                than 10mb.<\/p>\n        <\/li>\n    <\/ul>\n\n\n\n    <h3 id=\"data-file-upload\">Directly uploading a single data file<\/h3>\n    <p><b>To upload a direct data file:<\/b><\/p>\n    <ol>\n        <li>\n            <p>Ensure that you are logged into the TT platform with an administrator account and open the Setup\n                application.<\/p>\n        <\/li>\n        <li>\n            <p>In the Setup application, select <b>Company Settings<\/b> | <b>Data Uploads<\/b> in the left navigation\n                pane.<\/p>\n\n            <p><img decoding=\"async\" class=\"img-responsive\" src=\"https:\/\/library-staging.tradingtechnologies.com\/wp-content\/uploads\/2025\/12\/trade-surveillance-file-upload-direct.png\" alt=\"\"><\/p>\n        <\/li>\n        <li>\n            <p>Press the <b>New Upload<\/b> button. The <b>Upload File<\/b> window displays.<\/p>\n\n        <\/li>\n        <li>\n            <p>In the <b>Select File Type<\/b> dropdown, select either <b>Trayport Market Activity File<\/b> or <b>Generic\n                    Audit Trail File<\/b> depending on the type of file you wish to upload.\n            <\/p>\n            <p><img decoding=\"async\" class=\"img-responsive\" src=\"https:\/\/library-staging.tradingtechnologies.com\/wp-content\/uploads\/2025\/12\/trade-surveillance-file-upload-menu.png\" alt=\"\"><\/p>\n\n        <\/li>\n        <li>\n            <p>For <b>Generic Audit Trail File<\/b>, select <b>CSV<\/b> in the <b>Select File Format<\/b> dropdown menu.\n                For <b>Trayport Market Activity File<\/b>, you can select either <b>CSV<\/b> or, if uploading a compressed\n                csv file, select <b>ZIP<\/b>.\n            <\/p>\n        <\/li>\n        <li>\n            <p>Press the <b>Choose File&#8230;<\/b> button and navigate to the location of your file.<\/p>\n        <\/li>\n        <li>Optionally, check <b>Continue on Error<\/b>.\n            When this option is checked (enabled), Setup continues uploading data regardless of how many upload\n            errors may be logged and shown in the <b>Upload Errors<\/b> section. By default, this option is unchecked\n            (disabled) and the upload stops when the first error is detected.\n        <\/li><li>Press the <b>Upload<\/b> button to begin the file upload.<\/li>\n    <\/ol>\n\n    <p>A record of the uploaded file and its status appears in the grid. Click the checkbox next to the record to\n        review the Output section, which displays how many rows of the file are processed. Any errors that occur\n        during the upload will appear in an Error section on this page.<\/p>\n\n    <h3 id=\"auto-upload\">Uploading via the Auto Upload<\/h3>\n    <p>As a company administrator, you can use the Auto Uploads tab to schedule recurring, automated data file uploads.\n        The uploads can be scheduled to occur at the days and times that best suit your company&#8217;s business needs.<\/p>\n    <p>When creating a schedule, you can set the time (UTC) and days of the week that the upload will run, as well as:\n    <\/p>\n    <ul>\n        <li>Select a file format<\/li>\n        <li>Schedule retry attempts<\/li>\n        <li>Select a secured FTP site as the source of the data upload<\/li>\n        <li> Modify existing upload schedules<\/li>\n        <li>Schedule multiple uploads<\/li>\n        <li>View results of the uploads<\/li>\n\n    <\/ul>\n\n    <h4 id=\"file-name\">Setting the File Name for Automatic Uploads<\/h4>\n\n    <p>When setting the <b>File Name<\/b> field, you should set this value equal to\n        <b><i>Companyname<\/i>-%y%m%d<i>(-N)<\/i>.csv.zip<\/b> where:\n\n    <\/p><ul>\n\n        <li><i>Companyname<\/i> equals the name of your firm.<\/li>\n        <li><b>-%y%m%d<\/b> configures Setup to look for a file with the year, month, and the current date.<\/li>\n        <li><i>-N<\/i> represents an optional flag to upload a file dated <i>N<\/i> days prior.<\/li>\n    <\/ul>\n\n    <p>Setting <b>File Name<\/b> to <b>Trading_Firm-%y%m%d.csv.zip<\/b> causes the server to always upload a file with the current date.<\/p>\n\n    <p>While setting <b>File Name<\/b> to <b>Trading_Firm-%y%m%d(-1).csv.zip<\/b> causes the server to always upload the previous day&#8217;s file.<\/p>\n\n\n\n\n\n    <p><b>To schedule automatic uploads:<\/b><\/p>\n\n    <ol>\n        <li>\n            <p>Ensure that you are logged into the TT platform with an administrator account and open the Setup\n                application.<\/p>\n        <\/li>\n        <li>Click <b>Company Settings<\/b> | <b>Auto Uploads<\/b> in the left navigation pane.<\/li>\n        <li>Click <b>+ New Auto Upload<\/b>.<\/li>\n        <li>\n            <p>In the <b>Auto Upload Settings<\/b> screen, configure the following (all settings are required unless\n                noted):<\/p>\n            <ul>\n                <li>\n                    <p><b>Name<\/b> \u2014 Enter a name for the scheduled upload. When adding multiple schedules, each\n                        name must be unique.<\/p>\n                <\/li>\n                <li>\n                    <p><b>Protocol<\/b> \u2014 Select a protocol to use for uploading the data (e.g., SFTP).<\/p>\n                <\/li>\n                <li>\n                    <p><b>Server<\/b> \u2014 Enter the server hostname that is the source of the data\n                        upload. The SFTP port is automatically set to &#8220;22.&#8221;<\/p>\n                <\/li>\n                <li>\n                    <p><b>Path<\/b> \u2014 Enter the path to the file being uploaded from the server. This field is\n                        optional.<\/p>\n                <\/li>\n                <li>\n                    <p><b>Username<\/b> \u2014 Sets the username for logging in to the server.<\/p>\n                <\/li>\n                <li>\n                    <p><b>Password<\/b> \u2014 Sets the password for logging in to the server.<\/p>\n                <\/li>\n                <li>\n                    <p><b>File Name<\/b> \u2014 Enter the name of the file being uploaded.<\/p>\n                    <p>Set the file name equal to the <b><\/b><i>Companyname<\/i>-%y%m%d<i>(-N)<\/i>.csv.zip where\n                        <i>Companyname<\/i> equals the name of your firm and the optional -N flag equals the number of days prior to the\n                        current day. For guidance on setting this value, refer to the <a href=\"#file-name\">Setting the\n                            File Name for Automatic Uploads<\/a> section above.\n                    <\/p>\n                <\/li>\n                <li>\n                    <p><b>Start Time (UTC):<\/b> \u2014 Sets time at which to upload the file to TT. Enter a time in\n                        UTC in the hh:mm format (e.g., 23:59).<\/p>\n                <\/li>\n                <li>\n                    <p><b>Retry For (Minutes)<\/b> \u2014 Sets how long to wait before retrying the upload. Enter a\n                        time in minutes.<\/p>\n                <\/li>\n                <li>\n                    <p><b>Days to Run<\/b> \u2014 Select which days to run the automated upload.<\/p>\n                <\/li>\n                <li>\n                    <p><b>File Type<\/b> \u2014 Select the file type (i.e., <b>Trayport Market Activity File<\/b> or\n                        <b>Generic Audit Trail File<\/b>).\n                    <\/p>\n                <\/li>\n                <li>\n                    <p><b>File Format<\/b> \u2014 Select the <b>csv<\/b> format for the selected\n                        file type.<\/p>\n                <\/li>\n                <li>\n                    <p><b>Continue on error<\/b> \u2014 When this option is checked (enabled), Setup stops logging\n                        after 20 errors, but continues to upload the file. When it is unchecked, Setup stops uploading\n                        data once it logs 20 errors. This option is unchecked (disabled) by\n                        default.<\/p>\n                <\/li>\n\n                <!--  <p> ?? \n\t         \tBeing able to choose to get an alert only if the file is missing, or for all errors. Add your email, too?<\/p> -->\n            <\/ul>\n\n\n        <\/li><li>\n            <p>Click <b>Create<\/b>.<\/p>\n            <p>The schedule appears in the Auto Uploads grid at the top of the screen.<\/p>\n\n            <p>Results of the upload are stored in <b>Data Uploads<\/b>.\n\n        <\/p><\/li>\n    <\/ol>\n\n    <p>Refer to the <a href=\"\/user-setup\/rm-scheduling-automated-data-uploads.html\">Scheduling\n            Automated Data Uploads<\/a> section in the Setup help for more information on creating, modifying, and\n        viewing the results for your automated uploads. <\/p>\n<\/section>\n\n<section>\n    <h2 id=\"viewing-results\">Viewing Automated Upload Results<\/h2>\n\n    <p>After the scheduled upload runs, the Setup application displays the results and stores a record of the file\n        upload on the <b>Data Uploads<\/b> page. Click <b>Data Uploads<\/b> in the left-navigation pane to view a log of\n        the results.\n    <\/p>\n<\/section>\n<section>\n    <h2 id=\"considerations\">Additional Considerations<\/h2>\n\n    <p>Trade Surveillance processing time depends on the size of the data.<\/p>\n\n    <p>At this time, TT does not validate the data. If the data does not appear correctly in TT Trade Surveillance, you should\n        double-check that\n        the file&#8217;s data correctly matches the Generic Audit Trail File.<\/p>\n\n\n<\/section>\n","protected":false},"excerpt":{"rendered":"<p>Overview TT Trade Surveillance offers the ability to upload data via a .csv file. This allows users to easily  [&hellip;]<\/p>\n","protected":false},"author":2,"template":"","meta":{"_acf_changed":false,"footnotes":""},"docs-category":[497],"class_list":["post-7243","doc","type-doc","status-publish","hentry","docs-category-reference-tt-trade-surveillance"],"acf":[],"_links":{"self":[{"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/doc\/7243","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/doc"}],"about":[{"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/types\/doc"}],"author":[{"embeddable":true,"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/users\/2"}],"version-history":[{"count":0,"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/doc\/7243\/revisions"}],"wp:attachment":[{"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/media?parent=7243"}],"wp:term":[{"taxonomy":"docs-category","embeddable":true,"href":"https:\/\/library-staging.tradingtechnologies.com\/ja\/wp-json\/wp\/v2\/docs-category?post=7243"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}