com.attivio.service

Class MockUnclusteredIngestionHistory

java.lang.Object

com.attivio.service.MockUnclusteredIngestionHistory

All Implemented Interfaces:

IngestionHistoryApi, Closeable, AutoCloseable

public class MockUnclusteredIngestionHistory
extends Object
implements IngestionHistoryApi, Closeable

acts like UnclusteredIngestionHistory (hsql) and HBaseIngetsionHistory. Resides in this package since needed by TestCuratorFrameworkBuilder 1. children(grandchildren) of children(child) - api's undefined consequences specific for this class this class will create a map using the child key with the grandchild being the child. Once created these children are never referenced. That means getting a list of children for a document will not get these grandchildren. Deleting a document will not remove these grandchildren.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	MockUnclusteredIngestionHistory.Data

Constructor Summary

Constructors

Constructor and Description
MockUnclusteredIngestionHistory()

Method Summary

Modifier and Type	Method and Description
void	childCreated(String namespace, String key, String childKey) Marks the childKey as one created by the record associated with key.
void	clear(String namespace) Removes all historical information associated with the namespace.
void	close()
protected List<String>	getAllChildData(String namespace)
protected List<String>	getAllDocumentData(String namespace)
Iterable<String>	getChildren(String namespace, String key) Returns an Iterable of the children that were marked as created via the IngestionHistoryApi.childCreated(String, String, String) method.
Date	getPreviousStartTime(String namespace) Returns the start time for the last session for this namespace.
byte[]	getSignature(String namespace, String key) Returns the last signature associated with the key or null if no signature is present.
Date	getStartTime(String namespace) Returns the start time of the current session for this namespace.
Iterable<String>	getUnvisited(String namespace) Returns an Iterable of the keys that have not been visited in the current session.
Iterable<String>	getUnvisited(String namespace, Date since) Returns an Iterable of the keys that have not been visited since the time since.
void	removeDocumentByKey(String namespace, String key) Removes a document using the key
Date	startSession(String namespace) Starts a new session for the namespace.
protected void	updateDocumentWithDate(String namespace, String key, byte[] signature, Date useDate)
protected void	updateDocumentWithDate(String namespace, String key, Date useDate)
void	visit(String namespace, String key, byte[] signature) Records the key as having been visited updates its associated signature.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MockUnclusteredIngestionHistory

public MockUnclusteredIngestionHistory()

Method Detail

startSession

public Date startSession(String namespace)
                  throws AttivioException

Description copied from interface: IngestionHistoryApi

Starts a new session for the namespace. The current time is used to establish the start time for this session. Subsequent calls to IngestionHistoryApi.getStartTime(String) will return the new session start time.

Specified by:

startSession in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

Returns:

the session start time

Throws:

AttivioException

getStartTime

public Date getStartTime(String namespace)
                  throws AttivioException

Description copied from interface: IngestionHistoryApi

Returns the start time of the current session for this namespace. The return value is the same as the value returned by the last IngestionHistoryApi.startSession(String) call for this namespace. If no session has ever been started, returns null.

Specified by:

getStartTime in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

Returns:

the start time for this namespace

Throws:

AttivioException

getPreviousStartTime

public Date getPreviousStartTime(String namespace)
                          throws AttivioException

Description copied from interface: IngestionHistoryApi

Returns the start time for the last session for this namespace. If no previous session exists, returns null.

Specified by:

getPreviousStartTime in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

Returns:

previous start time

Throws:

AttivioException

visit

public void visit(String namespace,
                  String key,
                  byte[] signature)
           throws AttivioException

Description copied from interface: IngestionHistoryApi

Records the key as having been visited updates its associated signature. The signature is commonly used to detect whether an object has changed since the last ingestion (by storing a checksum or message digest of the content). The visit time is also recorded.

Specified by:

visit in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

key - a record key or document ID.

signature - an arbitrary value indicating a signature to associate with the key, may be null.

Throws:

AttivioException

getSignature

public byte[] getSignature(String namespace,
                           String key)
                    throws AttivioException

Description copied from interface: IngestionHistoryApi

Returns the last signature associated with the key or null if no signature is present.

Specified by:

getSignature in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

key - a record key or document ID.

Returns:

the signature associated with the key

Throws:

AttivioException

getUnvisited

public Iterable<String> getUnvisited(String namespace)
                              throws AttivioException

Description copied from interface: IngestionHistoryApi

Returns an Iterable of the keys that have not been visited in the current session. The unvisited keys are those for which there has been a IngestionHistoryApi.visit(String, String, byte[]) call at some point, but not one since the last IngestionHistoryApi.startSession(String) call. This allows a connector to record visits each time it runs and get a list of documents that are not present on subsequent runs. Since these documents have been removed from the source system, the connector may decide to remove them from the Attivio system.

A call to remove() on the returned iterator will remove the visit and signature information from the history for the associated key. All child associations (see IngestionHistoryApi.childCreated(String, String, String) of removed keys are also removed.

Specified by:

getUnvisited in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

Returns:

a Iterable of unvisited keys

Throws:

AttivioException

getUnvisited

public Iterable<String> getUnvisited(String namespace,
                                     Date since)
                              throws AttivioException

Description copied from interface: IngestionHistoryApi

Returns an Iterable of the keys that have not been visited since the time since. The unvisited keys are those for which there has been a IngestionHistoryApi.visit(String, String, byte[]) call at some point, but not one since the time since. This allows a connector to record visits each time it runs and get a list of documents that are not present on subsequent runs. Since these documents have been removed from the source system, the connector may decide to remove them from the Attivio system.

A call to remove() on the returned iterator will remove the visit and signature information from the history for the associated key. All child associations (see IngestionHistoryApi.childCreated(String, String, String) of removed keys are also removed.

Specified by:

getUnvisited in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

since - the mininum visit date to consider a record as visited.

Returns:

an Iterable of unvisited keys

Throws:

AttivioException

childCreated

public void childCreated(String namespace,
                         String key,
                         String childKey)
                  throws AttivioException

Description copied from interface: IngestionHistoryApi

Marks the childKey as one created by the record associated with key. All children associated with key are returned by the Iterable returned by a subsequent call to IngestionHistoryApi.getChildren(String, String). The expectation is that the child document has not previously been created. If the signature of the parent document id has changed remove the children documents and add the ones found in the new version of the parent document. Adding a child that already existed will have undefined consequences.

This does not support children of children, only supports parent document and it's children. Children of children will have undefined consequences.

Specified by:

childCreated in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

key - a record key or document ID.

childKey - a record key or document ID.

Throws:

AttivioException

getChildren

public Iterable<String> getChildren(String namespace,
                                    String key)
                             throws AttivioException

Description copied from interface: IngestionHistoryApi

Returns an Iterable of the children that were marked as created via the IngestionHistoryApi.childCreated(String, String, String) method. When using the returned Iterable and removing children then the expectation is that all the children are removed.

Specified by:

getChildren in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

key - a record key or document ID.

Returns:

an Iterable of childKeys for the key

Throws:

AttivioException

clear

public void clear(String namespace)
           throws AttivioException

Description copied from interface: IngestionHistoryApi

Removes all historical information associated with the namespace.

Specified by:

clear in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

Throws:

AttivioException

removeDocumentByKey

public void removeDocumentByKey(String namespace,
                                String key)
                         throws AttivioException

Description copied from interface: IngestionHistoryApi

Removes a document using the key

Specified by:

removeDocumentByKey in interface IngestionHistoryApi

Parameters:

namespace - a namespace to use (e.g., connector or source name)

key - a record key or document ID.

Throws:

AttivioException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

updateDocumentWithDate

protected void updateDocumentWithDate(String namespace,
                                      String key,
                                      Date useDate)
                               throws AttivioException

Throws:

AttivioException

getAllChildData

protected List<String> getAllChildData(String namespace)
                                throws AttivioException

Throws:

AttivioException

getAllDocumentData

protected List<String> getAllDocumentData(String namespace)
                                   throws AttivioException

Throws:

AttivioException

updateDocumentWithDate

protected void updateDocumentWithDate(String namespace,
                                      String key,
                                      byte[] signature,
                                      Date useDate)
                               throws AttivioException

Throws:

AttivioException