(Tag suggestions welcome, was not 100% sure on which tags to include. E.g. I don't know if odbc is a relevant tag here or not, I included it since I have a working odbc connection and it's the only type of connection I know about)
Using odbc I have a connection between an EC2 server and our company EMR cluster. Using packages and connection objects in my analytics environment (R) I am able to send SQL like queries including getting data from a table and writing data to a table (via S3).
But I need to run a more general Hive command, MSCK repair table [tablename]. This is part of a cron job where I send data each day to S3 using R's noctua package. In order to get Hive to recognize these new partitions, I need to run the above command. Till now I've had to login to our EMR each day and run it directly from within the terminal. I would like to, if possible, do this automatically as part of my cron job via my EC2, right at the end (the last part of the job, so as the data are definitely there before running MSCK...
Is it possible to run a hive command on EMR via a separate EC2 server with a connection of some kind, odbc or another way?