Hello,
I'm running Airflow 1.10.10 and using the GCSToBigQueryOperator from airflow.providers.google.cloud.transfers.gcs_to_bigquery in order to load data from google cloud storage into a big query table.
Although everything is working as expected, I keep seeing (a lot of) deprecation warnings in my logs:
DeprecationWarning: The bigquery_conn_id parameter has been deprecated. You should pass the gcp_conn_id parameter.
bigquery.py:103: DeprecationWarning: This method will be deprecated. Please useBigQueryHook.get_clientmethod
taskinstance.py:984: DeprecationWarning: This method is deprecated. Please use airflow.providers.google.cloud.hooks.bigquery.BigQueryHook.run_load
bigquery.py:1614: DeprecationWarning: This method is deprecated. Please useBigQueryHook.insert_jobmethod.
Although everything is working well, I'm afraid that in the future those warnings will indeed cause problems.
Please update the code and find a way to use the suggested methods instead of the deprecated ones.
If any more information is needed from me regarding the warnings or my system I will be happy to add it.
Thank you!
Thanks for opening your first issue here! Be sure to follow the issue template!
Thanks for the issue @chenmic ! I think same goes for other BQ transfer operators as they were not refactored to use new methods.
Is this one anything of a priority?
This is a P4 level ticket. However, it is worth fixing this problem.
"P1" means Critical Impact – Service Unusable in Production
"P2" means High Impact – Service Use Severely Impaired
"P3" means Medium Impact – Service Use Partially Impaired
"P4" means Low Impact – Service Fully Usable
@mik-laj - I'm happy to take it as a P4. Plenty else to work on, but I can grab it when time allows.
@coopergillan I assigned you to this ticket.
Most helpful comment
@coopergillan I assigned you to this ticket.