This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Mass Migration Using Importer

We do our migrations from a server, so its up and running non stop. The C: Drive of that server usually gets filled up as the migration goes on, causing problems when the drive gets completely full. 

Are not the files being copied from the original location directly to the M-Files? Why is the C: drive being filled up? How does the process works?

Thanks.

Parents
  • We imported hundreds of GBs of files before and it never touched the C drive.  Can you tell what files are being added to the drive that are filling it up?  Can you share your settings xml file so we can take a look? It could be some crazy logging you have enabled?

  • The weird thing is that I cannot locate the files, not sure exactly what happens but he drive gets filled up somehow.

    These files are going to a Cloud Vault.

    Here is the XML:

    <?xml version="1.0" encoding="utf-8"?>
    <ToolSettings xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
      <Name>Example Excel Settings for Excel Files</Name>
      <Description>This file contains example settings for M-Files Importer. It demonstrates how you can import data from an Excel file. You can test this with the Sample Vault.</Description>
      <GeneralOptions>
        <DataFileType>XLSX</DataFileType>
        <CacheValueListItems>true</CacheValueListItems>
        <RequireSourceFileForFirstDocumentObjectVersion>true</RequireSourceFileForFirstDocumentObjectVersion>
        <MaxAttemptsToFindSourceFile>0</MaxAttemptsToFindSourceFile>
        <DelayBetweenAttemptsInMillis>1000</DelayBetweenAttemptsInMillis>
        <ForceRelativePaths>false</ForceRelativePaths>
        <DelayForUserInterfaceInMillis>10</DelayForUserInterfaceInMillis>
        <ACLParameterForCreatedObjects>TypeDefaultACL</ACLParameterForCreatedObjects>
        <IncludeOriginalPathForSFDs>false</IncludeOriginalPathForSFDs>
      </GeneralOptions>
      <ErrorOptions>
        <LogFolder />
        <WriteLog>Simple</WriteLog>
        <WriteErrorFile>true</WriteErrorFile>
        <WriteResultFile>false</WriteResultFile>
        <CopyDataFiles>Never</CopyDataFiles>
        <DeleteSourceFiles>Never</DeleteSourceFiles>
        <DeleteDataFiles>Never</DeleteDataFiles>
        <WriteSystemErrorsToFile>true</WriteSystemErrorsToFile>
        <WriteSystemErrorsToWindowsApplicationLog>true</WriteSystemErrorsToWindowsApplicationLog>
        <ShowErrorDialogInSilentMode>false</ShowErrorDialogInSilentMode>
        <ErrorClassID>-1</ErrorClassID>
      </ErrorOptions>
      <MonitoringOptions>
        <MonitoredFolder />
        <MonitoredSubfoldersTextFile />
        <MonitoredSubfolderRegex />
        <MonitoringContinuously>false</MonitoringContinuously>
        <MonitoringIntervalInSeconds>60</MonitoringIntervalInSeconds>
        <MonitoringStartTime />
        <MonitoringEndTime />
      </MonitoringOptions>
      <TransmittalOptions>
        <TransmittalClassID>-1</TransmittalClassID>
        <TransmittalPropertyID>-1</TransmittalPropertyID>
        <LinkFromTransmittalToImportedObject>NoLink</LinkFromTransmittalToImportedObject>
      </TransmittalOptions>
      <DuplicateOptions>
        <EnableDuplicateDetection>true</EnableDuplicateDetection>
        <ReplaceDuplicate>Always</ReplaceDuplicate>
        <MaxAttemptsToReplaceDuplicate>2</MaxAttemptsToReplaceDuplicate>
        <DelayBetweenAttemptsInMillis>5000</DelayBetweenAttemptsInMillis>
        <AllowEmptyValuesInSearchConditions>false</AllowEmptyValuesInSearchConditions>
      </DuplicateOptions>
      <TimestampOptions>
        <GetFirstVersionCreatedAndModifiedTimestampsFromFile>true</GetFirstVersionCreatedAndModifiedTimestampsFromFile>
        <GetLaterVersionsModifiedTimestampFromFile>false</GetLaterVersionsModifiedTimestampFromFile>
        <ConvertToUTC>true</ConvertToUTC>
      </TimestampOptions>
      <MFConnectionOptions>
        <MaxAttemptsToRecreateLostConnection>0</MaxAttemptsToRecreateLostConnection>
        <DelayBetweenConnectionAttemptsInMillis>1000</DelayBetweenConnectionAttemptsInMillis>
        <RetryMFilesAPICallAfterRecreatingLostConnection>true</RetryMFilesAPICallAfterRecreatingLostConnection>
        <IsMFilesClientApplication>true</IsMFilesClientApplication>
        <ConnectInteractively>false</ConnectInteractively>
        <MFAuthenticationType>MFAuthTypeSpecificMFilesUser</MFAuthenticationType>
        <MFUsername>mfilesuser1@istar.com</MFUsername>
        <MFPassword>###CF2tdGswRyg+hQCtm8gYMzNwNDzAN1h/xZ2KaZFRPmA=</MFPassword>
        <MFDomain>istarfinancial.com</MFDomain>
        <MFProtocolSequence>ncacn_http</MFProtocolSequence>
        <MFHost>https://istar.cloudvault.m-files.com</MFHost>
        <MFPort>4466</MFPort>
        <MFLocalComputerName />
        <MFAllowAnonymousConnection>false</MFAllowAnonymousConnection>
        <MFVaultGUID>{099851CD-DF97-411A-846D-64ADEFAA5581}</MFVaultGUID>
        <MFTimeZone />
        <MFSPN />
        <MFEncryptedConnection>false</MFEncryptedConnection>
      </MFConnectionOptions>
      <CSVFileOptions>
        <CSVEncoding>windows-1252</CSVEncoding>
        <CSVSeparator>;</CSVSeparator>
        <CSVListSeparator>|</CSVListSeparator>
        <CSVQuotation>"</CSVQuotation>
        <SupportMultilineValues>false</SupportMultilineValues>
      </CSVFileOptions>
      <ExcelOptions>
        <ExcelConnectionString>Provider=Microsoft.ACE.OLEDB.12.0;Data Source={0};Extended Properties="Excel 12.0;HDR=NO;IMEX=1"</ExcelConnectionString>
        <ExcelSheetName>Sheet1$</ExcelSheetName>
        <ExcelOverwriteExistingCsvFile>false</ExcelOverwriteExistingCsvFile>
      </ExcelOptions>
      <XMLOptions>
        <XMLEncoding>UTF-8</XMLEncoding>
        <XMLListSeparator>|</XMLListSeparator>
        <XMLItemSelector />
        <XMLMustContainItems>true</XMLMustContainItems>
        <XMLMappingsMustExist>false</XMLMappingsMustExist>
        <XMLValidationFile />
      </XMLOptions>
      <FolderOptions>
        <CreateMfdFromDir>false</CreateMfdFromDir>
        <IncludeSubFolders>false</IncludeSubFolders>
        <MaxFileCountForDirectories>100</MaxFileCountForDirectories>
      </FolderOptions>
      <Mappings>
        <Mapping>
          <Description />
          <Source>Class_ID</Source>
          <ID>100</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>Doc_Type_ID</Source>
          <ID>1062</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>Doc_Sub_Type_ID</Source>
          <ID>1063</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>Doc_Sub_Type2_ID</Source>
          <ID>1142</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>Year_ID</Source>
          <ID>1091</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>File_Name</Source>
          <ID>0</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>File_Location</Source>
          <ID>-1001</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
        <Mapping>
          <Description />
          <Source>Workflow_ID</Source>
          <ID>38</ID>
          <FixedValue />
          <Duplicate>false</Duplicate>
          <CanSetEmpty>false</CanSetEmpty>
          <ValueListOptions>
            <Mode>NameOrInternalID</Mode>
            <CreateNewValueListItems>false</CreateNewValueListItems>
            <MustExist>true</MustExist>
          </ValueListOptions>
        </Mapping>
      </Mappings>
    </ToolSettings>

  • I don't see anything out of the ordinary here.  I thought maybe it was a rogue logging setting, but you mostly use what I use and I've never filled up.  As for finding the stuff taking up space, have you ever used WinDirStat or a tool like it? It can tell you where all your files are and what's taking up space. https://windirstat.net/

Reply Children