My hive external table(non partitioned) has data in an S3 bucket. It is an incremental table.

Until today all the files that come to this location through an Informatica process, were of the same structure and all the fields are included columns in my incremental table structure.

Now I have a requirement the a new file comes to the same bucket in additiona to the existing ones, but with additional columns.

I have re-created table with the additional columns.

But when I query the table, I see that the newly added columns are still blank for those specific line items where they are not supposed to be.

Can I actually have a single external table pointing to an S3 location having different file structures?