Srsly needs to be a way to link to the precise content within the page. :P
"In the New Linked Service window, select Data Store > Azure Databricks, and then select Continue."
Should be:
"In the New Linked Service window, select Compute > Azure Databricks, and then select Continue."
⚠Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.
@Mike-EEE Thanks for the feedback! I have assigned the issue to the content author to investigate further and update the document as appropriate.
Is there a way to specify cluster python version within Databricks notebook activity?
This content is still incorrect and has not been updated.
"In the New Linked Service window, select Data Store > Azure Databricks, and then select Continue." should be 'select Compute > Azure Databricks".....
Any comment @MicahMcKittrick-MSFT ? @nabhishek ?
@jason-j-MSFT can you help look into this one?
Cooooooool thanks, team. :D
Any luck, @jason-j-MSFT / @MicahMcKittrick-MSFT ?
@Mike-EEE we are working offline to engage the content author. Will update when we have more :)
I think the python syntax in your Notebook code is incorrect. The print() function needs the parentheses.
Is there a way to specify cluster python version within Databricks notebook activity?
@hiteshtulsani Yes, you can specify spark environment variable to specify a python 3 cluster in the databricks linked service. (In ADF UI -> Databricks linked service (new or edit) -> Additional cluster settings -> Cluster Spark environment variables, add Name -> PYSPARK_PYTHON, Value-> /databricks/python3/bin/python3)
In future, we will provide a simple dropdown in the UI to select Python version.
@bcas997 It depends on which python version are you using. this works for me.
@nabhishek forgive me if I missed something obvious here but Python had nothing to do with the issue I posted. :) From my understanding @MicahMcKittrick-MSFT is looking for a content author to address the copy. Please let me know what I have misunderstood here.