M-Files is a 2025 Gartner Peer Insights Customers' Choice for Document Management
️️➡️Download the report!

Options
  • State Suggested Answer
  • Locked Locked
  • Replies 6 replies
  • Answers 1 answer
  • Subscribers 11 subscribers
  • Views 899 views
  • Users 0 members are here
Related
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Mass Migration Using Importer

Moises

We do our migrations from a server, so its up and running non stop. The C: Drive of that server usually gets filled up as the migration goes on, causing problems when the drive gets completely full. 

Are not the files being copied from the original location directly to the M-Files? Why is the C: drive being filled up? How does the process works?

Thanks.

  • 0

    We imported hundreds of GBs of files before and it never touched the C drive.  Can you tell what files are being added to the drive that are filling it up?  Can you share your settings xml file so we can take a look? It could be some crazy logging you have enabled?

  • 0 in reply to DCPDamon

    The weird thing is that I cannot locate the files, not sure exactly what happens but he drive gets filled up somehow.

    These files are going to a Cloud Vault.

    Here is the XML:

    <?xml version="1.0" encoding="utf-8"?>
<ToolSettings xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <Name>Example Excel Settings for Excel Files</Name>
  <Description>This file contains example settings for M-Files Importer. It demonstrates how you can import data from an Excel file. You can test this with the Sample Vault.</Description>
  <GeneralOptions>
    <DataFileType>XLSX</DataFileType>
    <CacheValueListItems>true</CacheValueListItems>
    <RequireSourceFileForFirstDocumentObjectVersion>true</RequireSourceFileForFirstDocumentObjectVersion>
    <MaxAttemptsToFindSourceFile>0</MaxAttemptsToFindSourceFile>
    <DelayBetweenAttemptsInMillis>1000</DelayBetweenAttemptsInMillis>
    <ForceRelativePaths>false</ForceRelativePaths>
    <DelayForUserInterfaceInMillis>10</DelayForUserInterfaceInMillis>
    <ACLParameterForCreatedObjects>TypeDefaultACL</ACLParameterForCreatedObjects>
    <IncludeOriginalPathForSFDs>false</IncludeOriginalPathForSFDs>
  </GeneralOptions>
  <ErrorOptions>
    <LogFolder />
    <WriteLog>Simple</WriteLog>
    <WriteErrorFile>true</WriteErrorFile>
    <WriteResultFile>false</WriteResultFile>
    <CopyDataFiles>Never</CopyDataFiles>
    <DeleteSourceFiles>Never</DeleteSourceFiles>
    <DeleteDataFiles>Never</DeleteDataFiles>
    <WriteSystemErrorsToFile>true</WriteSystemErrorsToFile>
    <WriteSystemErrorsToWindowsApplicationLog>true</WriteSystemErrorsToWindowsApplicationLog>
    <ShowErrorDialogInSilentMode>false</ShowErrorDialogInSilentMode>
    <ErrorClassID>-1</ErrorClassID>
  </ErrorOptions>
  <MonitoringOptions>
    <MonitoredFolder />
    <MonitoredSubfoldersTextFile />
    <MonitoredSubfolderRegex />
    <MonitoringContinuously>false</MonitoringContinuously>
    <MonitoringIntervalInSeconds>60</MonitoringIntervalInSeconds>
    <MonitoringStartTime />
    <MonitoringEndTime />
  </MonitoringOptions>
  <TransmittalOptions>
    <TransmittalClassID>-1</TransmittalClassID>
    <TransmittalPropertyID>-1</TransmittalPropertyID>
    <LinkFromTransmittalToImportedObject>NoLink</LinkFromTransmittalToImportedObject>
  </TransmittalOptions>
  <DuplicateOptions>
    <EnableDuplicateDetection>true</EnableDuplicateDetection>
    <ReplaceDuplicate>Always</ReplaceDuplicate>
    <MaxAttemptsToReplaceDuplicate>2</MaxAttemptsToReplaceDuplicate>
    <DelayBetweenAttemptsInMillis>5000</DelayBetweenAttemptsInMillis>
    <AllowEmptyValuesInSearchConditions>false</AllowEmptyValuesInSearchConditions>
  </DuplicateOptions>
  <TimestampOptions>
    <GetFirstVersionCreatedAndModifiedTimestampsFromFile>true</GetFirstVersionCreatedAndModifiedTimestampsFromFile>
    <GetLaterVersionsModifiedTimestampFromFile>false</GetLaterVersionsModifiedTimestampFromFile>
    <ConvertToUTC>true</ConvertToUTC>
  </TimestampOptions>
  <MFConnectionOptions>
    <MaxAttemptsToRecreateLostConnection>0</MaxAttemptsToRecreateLostConnection>
    <DelayBetweenConnectionAttemptsInMillis>1000</DelayBetweenConnectionAttemptsInMillis>
    <RetryMFilesAPICallAfterRecreatingLostConnection>true</RetryMFilesAPICallAfterRecreatingLostConnection>
    <IsMFilesClientApplication>true</IsMFilesClientApplication>
    <ConnectInteractively>false</ConnectInteractively>
    <MFAuthenticationType>MFAuthTypeSpecificMFilesUser</MFAuthenticationType>
    <MFUsername>mfilesuser1@istar.com</MFUsername>
    <MFPassword>###CF2tdGswRyg+hQCtm8gYMzNwNDzAN1h/xZ2KaZFRPmA=</MFPassword>
    <MFDomain>istarfinancial.com</MFDomain>
    <MFProtocolSequence>ncacn_http</MFProtocolSequence>
    <MFHost>https://istar.cloudvault.m-files.com</MFHost>
    <MFPort>4466</MFPort>
    <MFLocalComputerName />
    <MFAllowAnonymousConnection>false</MFAllowAnonymousConnection>
    <MFVaultGUID>{099851CD-DF97-411A-846D-64ADEFAA5581}</MFVaultGUID>
    <MFTimeZone />
    <MFSPN />
    <MFEncryptedConnection>false</MFEncryptedConnection>
  </MFConnectionOptions>
  <CSVFileOptions>
    <CSVEncoding>windows-1252</CSVEncoding>
    <CSVSeparator>;</CSVSeparator>
    <CSVListSeparator>|</CSVListSeparator>
    <CSVQuotation>"</CSVQuotation>
    <SupportMultilineValues>false</SupportMultilineValues>
  </CSVFileOptions>
  <ExcelOptions>
    <ExcelConnectionString>Provider=Microsoft.ACE.OLEDB.12.0;Data Source={0};Extended Properties="Excel 12.0;HDR=NO;IMEX=1"</ExcelConnectionString>
    <ExcelSheetName>Sheet1$</ExcelSheetName>
    <ExcelOverwriteExistingCsvFile>false</ExcelOverwriteExistingCsvFile>
  </ExcelOptions>
  <XMLOptions>
    <XMLEncoding>UTF-8</XMLEncoding>
    <XMLListSeparator>|</XMLListSeparator>
    <XMLItemSelector />
    <XMLMustContainItems>true</XMLMustContainItems>
    <XMLMappingsMustExist>false</XMLMappingsMustExist>
    <XMLValidationFile />
  </XMLOptions>
  <FolderOptions>
    <CreateMfdFromDir>false</CreateMfdFromDir>
    <IncludeSubFolders>false</IncludeSubFolders>
    <MaxFileCountForDirectories>100</MaxFileCountForDirectories>
  </FolderOptions>
  <Mappings>
    <Mapping>
      <Description />
      <Source>Class_ID</Source>
      <ID>100</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Type_ID</Source>
      <ID>1062</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type_ID</Source>
      <ID>1063</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type2_ID</Source>
      <ID>1142</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Year_ID</Source>
      <ID>1091</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Name</Source>
      <ID>0</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Location</Source>
      <ID>-1001</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Workflow_ID</Source>
      <ID>38</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
  </Mappings>
</ToolSettings>

  • 0 in reply to DCPDamon

    The weird thing is that I cannot locate anything on the drive, but it does fill it up somehow.

    We are moving these files to a cloud vault, not sure if that makes any difference.

    Here is the XML used during that specific migration:

    <?xml version="1.0" encoding="utf-8"?>
<ToolSettings xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <Name>Example Excel Settings for Excel Files</Name>
  <Description>This file contains example settings for M-Files Importer. It demonstrates how you can import data from an Excel file. You can test this with the Sample Vault.</Description>
  <GeneralOptions>
    <DataFileType>XLSX</DataFileType>
    <CacheValueListItems>true</CacheValueListItems>
    <RequireSourceFileForFirstDocumentObjectVersion>true</RequireSourceFileForFirstDocumentObjectVersion>
    <MaxAttemptsToFindSourceFile>0</MaxAttemptsToFindSourceFile>
    <DelayBetweenAttemptsInMillis>1000</DelayBetweenAttemptsInMillis>
    <ForceRelativePaths>false</ForceRelativePaths>
    <DelayForUserInterfaceInMillis>10</DelayForUserInterfaceInMillis>
    <ACLParameterForCreatedObjects>TypeDefaultACL</ACLParameterForCreatedObjects>
    <IncludeOriginalPathForSFDs>false</IncludeOriginalPathForSFDs>
  </GeneralOptions>
  <ErrorOptions>
    <LogFolder />
    <WriteLog>Simple</WriteLog>
    <WriteErrorFile>true</WriteErrorFile>
    <WriteResultFile>false</WriteResultFile>
    <CopyDataFiles>Never</CopyDataFiles>
    <DeleteSourceFiles>Never</DeleteSourceFiles>
    <DeleteDataFiles>Never</DeleteDataFiles>
    <WriteSystemErrorsToFile>true</WriteSystemErrorsToFile>
    <WriteSystemErrorsToWindowsApplicationLog>true</WriteSystemErrorsToWindowsApplicationLog>
    <ShowErrorDialogInSilentMode>false</ShowErrorDialogInSilentMode>
    <ErrorClassID>-1</ErrorClassID>
  </ErrorOptions>
  <MonitoringOptions>
    <MonitoredFolder />
    <MonitoredSubfoldersTextFile />
    <MonitoredSubfolderRegex />
    <MonitoringContinuously>false</MonitoringContinuously>
    <MonitoringIntervalInSeconds>60</MonitoringIntervalInSeconds>
    <MonitoringStartTime />
    <MonitoringEndTime />
  </MonitoringOptions>
  <TransmittalOptions>
    <TransmittalClassID>-1</TransmittalClassID>
    <TransmittalPropertyID>-1</TransmittalPropertyID>
    <LinkFromTransmittalToImportedObject>NoLink</LinkFromTransmittalToImportedObject>
  </TransmittalOptions>
  <DuplicateOptions>
    <EnableDuplicateDetection>true</EnableDuplicateDetection>
    <ReplaceDuplicate>Always</ReplaceDuplicate>
    <MaxAttemptsToReplaceDuplicate>2</MaxAttemptsToReplaceDuplicate>
    <DelayBetweenAttemptsInMillis>5000</DelayBetweenAttemptsInMillis>
    <AllowEmptyValuesInSearchConditions>false</AllowEmptyValuesInSearchConditions>
  </DuplicateOptions>
  <TimestampOptions>
    <GetFirstVersionCreatedAndModifiedTimestampsFromFile>true</GetFirstVersionCreatedAndModifiedTimestampsFromFile>
    <GetLaterVersionsModifiedTimestampFromFile>false</GetLaterVersionsModifiedTimestampFromFile>
    <ConvertToUTC>true</ConvertToUTC>
  </TimestampOptions>
  <MFConnectionOptions>
    <MaxAttemptsToRecreateLostConnection>0</MaxAttemptsToRecreateLostConnection>
    <DelayBetweenConnectionAttemptsInMillis>1000</DelayBetweenConnectionAttemptsInMillis>
    <RetryMFilesAPICallAfterRecreatingLostConnection>true</RetryMFilesAPICallAfterRecreatingLostConnection>
    <IsMFilesClientApplication>true</IsMFilesClientApplication>
    <ConnectInteractively>false</ConnectInteractively>
    <MFAuthenticationType>MFAuthTypeSpecificMFilesUser</MFAuthenticationType>
    <MFUsername>mfilesuser1@istar.com</MFUsername>
    <MFPassword>###CF2tdGswRyg+hQCtm8gYMzNwNDzAN1h/xZ2KaZFRPmA=</MFPassword>
    <MFDomain>istarfinancial.com</MFDomain>
    <MFProtocolSequence>ncacn_http</MFProtocolSequence>
    <MFHost>https://istar.cloudvault.m-files.com</MFHost>
    <MFPort>4466</MFPort>
    <MFLocalComputerName />
    <MFAllowAnonymousConnection>false</MFAllowAnonymousConnection>
    <MFVaultGUID>{099851CD-DF97-411A-846D-64ADEFAA5581}</MFVaultGUID>
    <MFTimeZone />
    <MFSPN />
    <MFEncryptedConnection>false</MFEncryptedConnection>
  </MFConnectionOptions>
  <CSVFileOptions>
    <CSVEncoding>windows-1252</CSVEncoding>
    <CSVSeparator>;</CSVSeparator>
    <CSVListSeparator>|</CSVListSeparator>
    <CSVQuotation>"</CSVQuotation>
    <SupportMultilineValues>false</SupportMultilineValues>
  </CSVFileOptions>
  <ExcelOptions>
    <ExcelConnectionString>Provider=Microsoft.ACE.OLEDB.12.0;Data Source={0};Extended Properties="Excel 12.0;HDR=NO;IMEX=1"</ExcelConnectionString>
    <ExcelSheetName>Sheet1$</ExcelSheetName>
    <ExcelOverwriteExistingCsvFile>false</ExcelOverwriteExistingCsvFile>
  </ExcelOptions>
  <XMLOptions>
    <XMLEncoding>UTF-8</XMLEncoding>
    <XMLListSeparator>|</XMLListSeparator>
    <XMLItemSelector />
    <XMLMustContainItems>true</XMLMustContainItems>
    <XMLMappingsMustExist>false</XMLMappingsMustExist>
    <XMLValidationFile />
  </XMLOptions>
  <FolderOptions>
    <CreateMfdFromDir>false</CreateMfdFromDir>
    <IncludeSubFolders>false</IncludeSubFolders>
    <MaxFileCountForDirectories>100</MaxFileCountForDirectories>
  </FolderOptions>
  <Mappings>
    <Mapping>
      <Description />
      <Source>Class_ID</Source>
      <ID>100</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Type_ID</Source>
      <ID>1062</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type_ID</Source>
      <ID>1063</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type2_ID</Source>
      <ID>1142</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Year_ID</Source>
      <ID>1091</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Name</Source>
      <ID>0</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Location</Source>
      <ID>-1001</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Workflow_ID</Source>
      <ID>38</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
  </Mappings>
</ToolSettings>

  • 0 in reply to DCPDamon

    The strange thing is that I cannot locate them in the drive, but only happens when I do a large migration like this one.

    I've tried to inset the whole XML as text here but won't allow me, any particular setting I should loo into? 

  • 0 in reply to Moises

    I don't see anything out of the ordinary here.  I thought maybe it was a rogue logging setting, but you mostly use what I use and I've never filled up.  As for finding the stuff taking up space, have you ever used WinDirStat or a tool like it? It can tell you where all your files are and what's taking up space. https://windirstat.net/

  • 0 in reply to DCPDamon

    Interesting, I'll have a look.

    Thank you

M-Files
M-Files Support


© 2025 M-Files, All Rights Reserved.