A Required field is NOT Required in some cases in AEP

 We mark a field as "Required" while defining the XDM schemas. Obviously if you mark a field as required, you need to pass the value of the corresponding field while loading data into the dataset created from the schema. But there are some cases where you can load data even without supplying values for those fields. Let's get into the details.

Here the fields marked with pink are the fields marked as required. Here one field of type object called "node_filed_rf" (RF is Required Field and ignore the spellig ) is marked as required whereas the other similar object "node_filed_nrf" is not required. Both of them has a Required Field.

We created a DataSet from the schema with the same name as the schema.

Here is the sample data that is loaded into the Dataset with error threshold as 80% as we expect many of the rows will not be accepted.


Test
JSON DataSuccessComment
{"_id":"all_fields_exist","_abccominc":{"node_filed_nrf":{"nrf_under_nrf":"Sample value","rf_under_nrf":"Sample value"},"node_filed_rf":{"nrf_under_rf":"Sample value","rf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}YSuccess as All fields are present
{"_id":"nrn_rf_ne","_abccominc":{"node_filed_nrf":{"nrf_under_nrf":"Sample value"},"node_filed_rf":{"nrf_under_rf":"Sample value","rf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}NRF under NRN is missing
{"_id":"nrn_rf_ex","_abccominc":{"node_filed_nrf":{"rf_under_nrf":"Sample value"},"node_filed_rf":{"nrf_under_rf":"Sample value","rf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}YRF Exists in NRN
{"_id":"nrn_exist_empty","_abccominc":{"node_filed_nrf":{},"node_filed_rf":{"nrf_under_rf":"Sample value","rf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}NNRN node exists but empty
{"_id":"nrn_ne","_abccominc":{"node_filed_rf":{"nrf_under_rf":"Sample value","rf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}YThe NRN doesn't exists at all
{"_id":"rfn_rf_ex","_abccominc":{"node_filed_rf":{"rf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}YRF in RFN exists
{"_id":"rfn_rf_ne","_abccominc":{"node_filed_rf":{"nrf_under_rf":"Sample value"},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}NRF in RFN doesn't exist
{"_id":"rfn_exist_empty","_abccominc":{"node_filed_rf":{},"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}NRFN node eixsts with empty value
{"_id":"rfn_ne","_abccominc":{"top_level_nrf":"Sample value","top_level_rf":"Sample value"}}N_abccominc exists but RFN under it doesn't exist
{"_id":"top_level_rf_ne","_abccominc":{"node_filed_nrf":{"nrf_under_nrf":"Sample value","rf_under_nrf":"Sample value"},"node_filed_rf":{"nrf_under_rf":"Sample value","rf_under_rf":"Sample value"},"top_level_nrf":"Sample value"}}NTop level RD missing
{"_id":"no_custom_field_exist"}Y_abccominc node itself doesn't exist so missing RFN doesn't matter

RD = Required Fields, NRN = Not required node, RFN = Required Field Node

Error: Error: Missing Required Field {field}.



Summary:
  • If you want a field to be "Real" required, then make sure the whole chain leading to field is marked as required
  • If a field is required, it must be there if it's parent node (object) exists and even if the parent is just an empty object "{}"
  • Finally, there can't be any custom field that is "real" required. As the custom field will be part of the org specific node (Object) as in this case "_abccominc" and this node is read only and you can't mark it "Required" (refer to below picture)



Comments

Post a Comment

Popular posts from this blog

Avoid Proxy for HttpClientRequest - IOB-090007 Network error (send(), errno=10054: an existing connection was forcibly closed by the remote host

This is Friday night 8:10 PM and I was frustratingly stuck with an annoying issue on something that I have done so many times, but still unable to figure out what is wrong since last night. Finally it was a silly mistake and I found that. So wanted to capture it so that I don't need to spend another day and half just to figure out why the same thing is not working I was making a call to Silverpop XMLAPI to get the jessionid via the login method. And the code is something like below, very basic one var http = new HttpClientRequest ( "http://api2.ibmmarketingcloud.com/XMLAPI" ); try { http . method = 'POST' ; http . header [ "ClientId_Internal" ] = "XYZABCD" ; http . header [ "ClientSecret_Internal" ] = "DSFDSOFNJSDF" ; http . header [ "Content-Type" ] = "application/x-www-form-urlencoded" ; var reqestBody = "xml=" + encodeURIComponent ( "...
Read more

Looping using subset inside a big batch in Adobe Campaign

Image
 I had many scenarios where I ran a costly query to select some good no of records and then process them further. But when it comes to processing I had to restrict the number of records to be processed in one go. And once the subset is processed, then select from the table again and then process the subset. Something like below where the end activity calls the signal when the complement from Split has more than 0 records to start the whole process again. But the problem is every time you have to run the costly select process to process a fraction of the records. As a result the overall throughput is decreased heavily. As an alternate I used a looping through the selected records avoiding selection every time I need to process the subset. Here the JS Activity after select is dummy one but required. I added a log in it with count. Test activity is also needed to ensure we have the exit path from the loop. In the above example the select query fetched 8680 records and then split restr...
Read more

Adobe Campaign Survey - Save Variables into Database

Image
I had a scenario where I need to show some questions depending on the answers of a previous question. For example, the below test scenario So I created the Archive field for all the questions including the Radio button and Drop down one which will be used for the dynamic criteria. I had setup the visibility of the field using the Archive Field. But while previewing I realized that the questions are getting shown or hidden depending on selection (example below). So I created two new variables for the survey with names as How_was_your_last_hopital_visit and Was_your_out_of_pocket_expenses_over_budget_. Then changed the visibility criteria to use the variables. Now it is working perfectly. But when I saved the survey, it doesn't save the data of those variables. But I need those selections as well. So I added a javascript task before the Storage activity and set the tables fields from the variables so that when it is in the storage activity, it column value is populate...
Read more