LogoLogo
ProductsPricingGlossary Launch Acho
  • 🎉Welcome
  • Introduction
  • What is Acho?
  • How does Acho work?
    • Proof of Concept (PoC)
  • App Builder
    • Get Started
    • Core Concepts
    • Overview
    • App construction
      • App Configuration
      • Pages
      • Interactions
        • Add an interaction
        • Add conditions to interactions
        • Event payload
        • Ordering interactions with action flow
        • Transformer
        • Actions
          • Navigation
          • Element
          • Data Source
          • App
          • Page
          • API Service
          • Database
          • Media Service
      • Table
      • Metric
      • Query
      • Data Store
      • Elements
        • Table & Chart
          • Searchable Table
          • Table
          • Chart
          • Score Card
        • Form Elements
          • Form
          • Search Bar
          • Checkbox
          • Date Picker
          • Custom Form
          • Input
          • Multiselect
          • Radio Button
          • Radio List
          • Rich Text Editor
          • Select
          • Switch
          • Textarea
          • Upload
        • Web Elements
          • Badge
          • Button
          • Clickable
          • Collapse Menu
          • Divider
          • Icon
          • Image
          • Link
          • Message
          • Modal
          • Notification
          • Pagination
          • Popover
          • Rate
          • Rich Text
          • Tabs
          • Text
        • Layout Elements
          • Container
          • List
        • Advanced elements
          • Code Block
          • Condition
          • Print
        • CSS Styles
          • General techniques
          • Layout
          • Spacing
          • Size
          • Position
          • Typography
          • Background
          • Border
          • Effect
        • Form Check
        • Tooltip
      • Accessors
      • Plugin Store
    • Popular Use Cases
      • Build a chart from Table Nodes
      • Create a table
      • Create a list
      • Create a filter
      • Create a search bar
      • Use Custom Form Container to collect user inputs
      • Drill down on a table
      • Download file from query node
      • Set loading animations
      • Modify a database
      • Navigate to a different page
      • Set up dynamic routing
      • Update app data using accessors
      • Create a Chart with Code Block and D3 Library
      • Rich text and rich text editor
      • Send an Email via Mailjet Plugin
    • Preview
    • Publish
      • Embed published app on website
    • Version Control
    • App User Management
      • Onboarding Page
      • Sign in page
      • Guest Isolation and Private Session
    • Theme
    • FAQ
  • Acho Studio
    • Quick Start
    • Resources
      • Add a resource
      • Supported data sources
        • Airtable
        • Amazon Ads
        • Amplitude
        • Amazon Seller Partner
        • Apify Dataset
        • Appstore
        • Asana
        • API Connector
        • API Template
        • AWS CloudTrail
        • Azure Table Storage
        • Batch Files
        • Bamboo HR
        • BigCommerce
        • BigQuery
        • Bing Ads
        • Braintree
        • Cart.com
        • Chargebee
        • Chargify
        • Chartmogul
        • Clickhouse
        • Close.com
        • CockroachDB
        • Confluence
        • Customer.io
        • Delighted
        • Dixa
        • Drift
        • Facebook Marketing
        • Freshdesk
        • Freshsales
        • Freshservice
        • GitHub
        • GitLab
        • Google Ads
        • Google Analytics
        • Google Sheets
        • Google Search Console
        • Greenhouse
        • Harness
        • Harvest
        • HubSpot
        • IBM Db2
        • Instagram
        • Intercom
        • Iterable
        • Jenkins
        • Jira
        • Kafka
        • Klaviyo
        • Kustomer
        • Lemlist
        • Lever Hiring
        • LinkedIn Ads
        • Linnworks
        • Mailchimp
        • Marketo
        • Microsoft Teams
        • Mixpanel
        • Monday
        • MongoDB
        • MySQL
        • My Hours
        • NetSuite
        • Notion
        • Okta
        • OneDrive
        • OneSignal
        • Oracle DB
        • Outreach
        • PagerDuty
        • Paypal Transaction
        • Paystack
        • Pipedrive
        • PersistIq
        • Pinterest
        • Plaid
        • PostgreSQL
        • PostHog
        • PrestaShop
        • Qualaroo
        • QuickBooks
        • Recharge
        • Recurly
        • Remote File
        • S3
        • Salesforce
        • Salesloft
        • SearchMetrics
        • Sendgrid
        • Sentry
        • Short.io
        • Shopify
        • Single File
        • Slack
        • Smartsheets
        • Snapchat Marketing
        • Snowflake
        • SQL Server
        • Square
        • Stripe
        • SurveyMonkey
        • Tempo
        • TikTok Marketing
        • Trello
        • Twilio
        • Typeform
        • VictorOps
        • WooCommerce
        • YouTube Analytics
        • Zendesk Chat
        • Zendesk Sunshine
        • Zendesk Talk
        • Zendesk Support
        • Zenloop
        • Zoho CRM
        • Zoom
        • Zuora
    • Data Prep (Projects)
      • Create a Data Prep Project
        • Create a table tab
        • Copy a table tab
        • Hide a table tab
      • Apply an action
        • View
          • Hide Columns
          • Filter
          • Sort
          • Cut
          • Rename
          • Move Column
        • Combine Tables
          • Join
          • Union
        • Transformation
          • Pivot Table
          • Unpivot
        • Data Cleaning
          • Cleanse
          • Replace
          • Change Type
          • Deduplicate
          • Split
          • Flatten
        • Tools
          • Formula
          • SQL Editor
            • SQL Editor Queries
            • All functions in Formula/SQL
              • Mathematical Functions
              • String Functions
              • Date Functions
              • Datetime Functions
              • Time Functions
              • Timestamp Functions
              • Conditional Functions
              • Type Conversion
              • Other Functions
        • Reserved Keywords
      • Pipeline
      • Edit your pipelines
      • Generate column summary for inspection
      • Use URL to access and share your project
      • Write a description for your project
      • Delete a resources/project/tab
    • Data Flow
      • Export data
        • Download CSV files
        • Excel Connector
        • Google Sheets Connector
        • Embed a table on your website
          • Data Usage Agreement
        • Apache Superset
        • Chartio
        • Looker
        • Metabase
        • Power BI
        • Qlik
        • Tableau
        • MongoDB
        • MySQL
        • MSSQL
        • Snowflake
        • PostgreSQL
        • BigQuery
    • Set up Data Sync
    • FAQ
  • Organization
    • Get started
    • Create an organization
    • Invite people to your organization
    • Share your resources
    • Share your projects
    • Share your apps
    • Change payment method on file
  • FAQ
    • I can't find data after uploading a big CSV file
Powered by GitBook
On this page
  • Merge multiple files into a single file
  • Manage files in Batch Files
  • Add new files
  • Delete files
  • Update your table
  • Acho Meta Name
  • Troubleshooting
  • 1. Some of the rows disappear when I use Batch Files to upload files.

Was this helpful?

  1. Acho Studio
  2. Resources
  3. Supported data sources

Batch Files

PreviousAzure Table StorageNextBamboo HR

Last updated 2 years ago

Was this helpful?

Merge multiple files into a single file

1. Go to the Resources page and click the Add Resource button.

2. In the "Select a data source" step, navigate to Flat File > Batch Files.

3. Click Select Files to upload your files. Here you can upload a bunch of files at a time. There is no limit for the number of rows to upload. Before uploading files, please note that:

  • All data files should have the same schema (the same number of columns and the same data type for each column). However, the column names can be different.

  • Currently, Batch Files only supports .csv, .tsv, and .txt files. If you want to upload Excel (.xlsx) files, please choose Single File instead in Step 2.

  • The maximum number of files you can upload at a time is up to 100 files.

4. Then, in CSV Preview Setup, you can preview the first file. In this step, you can change the resource name or check if your file is parsed into the correct format. If your file doesn't have column names, you can switch to Safe mode to add a header row.

If all files don't have a header row and you don't add a header row in CSV Preview Setup, all files lose the first row. This is because the system will consider the first row as a header row automatically.

5. Click Upload and you will see the files are uploading in the bottom-right window. It may take a few minutes to several hours to upload all data files depending on the data size and the number of your files.

Manage files in Batch Files

Once you build up a Batch Files resource, you can go to File Management to add or delete files by clicking the dropdown menu next to your Batch Files resource.

Add new files

If you have new files and want to merge them into your current Batch Files, you can just click Add Files and choose data files to upload. Remember the new files should have the same schema as the one in the other files.

Delete files

In File Management, you can also delete some of the files in your Batch Files. Just navigate to the file that you want to delete and click the Delete button.

Update your table

If you add or delete files in your Batch Files resource, you can go to your project to retrieve the latest records without rebuilding your data pipeline.

Acho Meta Name

When you create a Batch Files Resource and import data to a project, you will find a new column called _acho_meta_name that doesn't exist in your dataset. This column is generated automatically when you upload files as a Batch Files. This can help you identify which rows originated from which data files and when these files are imported.

Troubleshooting

1. Some of the rows disappear when I use Batch Files to upload files.

This problem may happen when some of your data files don't have a header. If you face this situation, please follow the steps below to reupload your data:

Situation 1: All data files don't have a header

  1. Go to Resource and choose Batch Files to upload your files again.

  2. In Data Preview Setup, turn on the Safe Mode.

  3. Click Add a Header Row.

  4. Now, the system will add a header for all of your data files automatically.

Situation 2: Some of the data files don't have a header

There are two options to tackle this situation:

  • Option 1: Open the files consisting of headers, and remove their headers. Then, follow the steps in Situation 1 to re-upload these files.

  • Option 2: If you are not sure which files have headers and which ones don't, you can follow the steps in Situation 1 to re-upload files and add a header row (no matter whether a header already exists in Data Preview Setup). Then, import the Batch Files to a project and use Filter to filter out the header rows.

6. Once your Batch Files resource is built up, you can click the resource to enter into File Management. It shows the list of files that you just uploaded and their detailed information for each file. Here you can also or .

If you want to extract information from this column, you can use the action to separate this column or write a to extract a specific string in .

Split
regular expression
Formula
add new files
delete some of the files