Hi,
probably a little bit of a noob question but I have the following issue/question:
Receiving data every night and like to add this data automaticlly with the scheduler into my MySQL database.
Unfortunatly the data is not always ‘new’ data and consists the same data that is allready in the database.
Know I’m searching for the best solution in Amphi to solve this problem. Can anybody give me a little push for a solution?
Hi @harmenkuijer, that’s a typical use case
Whats the source data?
The best case would be to have a unique key in your data that you can use in MySQL to ignore the duplicates.
If not, there are other ways you could leverage in Amphi, like the deduplication either beforehand or using SQL too.
Let us know
I looked at my data and found a unique key that is provided with my source data, so added it to my dataframe. So I could do something with that 
The APPEND function in de database output does nothing with duplications 
The append function only adds to the table, without using a unique key, it will add duplicates. I believe this is the expected behavior