Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
Python Programming

Python Developer Survey Shows Data Analysis More Popular Than Web Development (jetbrains.com) 42

Over 20,000 programmers from more than 150 different countries provided answers for the second annual Python Developers Survey (conducted by the Python Software Foundation and JeBrains).

An anonymous reader submitted this condensed version of their results: 84% of Python users in our survey use Python as their main language...up 5 percentage points from 79% in 2017. But half of all Python users in the survey also use JavaScript, and 47% more say they use HTML/CSS. Reported use of Bash/Shell has also grown from 36% in 2017 to 45% in 2018. [Later 93% of respondents said that their activities included Software testing/Writing automated tests.] Python users who report that they also use Go and SQL have both increased by 2 percentage points, while many other languages (including C/C++, Java, and C#) have decreased their share...

When asked "What do you use Python for?" data analysis has become more popular than Web development, growing from 50% in 2017 to 58% in 2018. Machine learning also grew by 7 percentage points. These types of development are experiencing faster growth than Web development, which has only increased by 2 percentage points when compared to the previous year...

Almost two-thirds of respondents selected Linux as their development environment OS. Most people are using free or open source databases such as PostgreSQL, MySQL, or SQLite... Twenty-something was the prevalent age range among our respondents, with almost a third being in their thirties. [31% more were between the ages of 30 and 39.]

This discussion has been archived. No new comments can be posted.

Python Developer Survey Shows Data Analysis More Popular Than Web Development

Comments Filter:
  • and due in no small part to pandas. link [pydata.org]

    if used correctly (due to its NumPy foundation) with vectorised operations it rocks
    • How easy is it to use Python and Pandas to do these kinds of analytics? I have been exploring the Chicago crime data set as an example (see: https://www.kaggle.com/boldy71... [kaggle.com]) and I am interested to know how much expertise and time does it take to do something like this. I am building a data analytics tool that will allow non-programmers the ability to do simple analysis of large data sets using a point-and-click interface. I use this crime data set to test things out, but I want to explore more in-depth a
  • by jma05 ( 897351 ) on Saturday February 09, 2019 @01:22PM (#58094694)

    Most of the new users since perhaps around 2012 came for the data analytics side.

    IPython, NumPy, SciPy had been around for a while, but with maturing Jupyter, Pandas and TensorFlow/Keras, it really caught on. Other NLP and Machine Learning libraries probably helped too.

    My use of Python today is completely different from how I used it earlier, nearly two decades ago, when it was mainly seen as a better Perl, back when Perl was THE scripting language. Now it is seen as a better MATLAB or a better R, even though the base language isn't itself vectorized as the others. The language and the standard library didn't improve much towards this. It was mainly the third party libraries that emerged and matured.

    Speaking purely from a language standpoint, Julia has all right features for the analytics side, but the scientific community is right now with Python.

    • There's not really a reason to use Python on the web. It's fine for smaller websites (but then just use RoR) but when the website gets bigger, the lack of types will hurt a lot.
      • by tomhath ( 637240 )

        There's not really a reason to use Python on the web.

        True. It's better than most (especially Java or C/C++), but not the best choice.

        It's fine for smaller websites (but then just use RoR)

        Good grief, RoR was never a good choice; thankfully it's long dead. Node is the only sensible choice today.

        but when the website gets bigger, the lack of types will hurt a lot.

        Python is strongly typed, you can look it up.

        • by phantomfive ( 622387 ) on Saturday February 09, 2019 @05:10PM (#58096052) Journal

          Node is the only sensible choice today.

          For frontend, node is a reasonable choice. For backend, node has all the same problems as Python (a very lousy type system), plus backwards compatibility problems that are like butterflies on crack, plus security issues that don't really come up with other systems.

          Python is strongly typed, you can look it up.

          Python uses duck typing that is checked at runtime, not compile time. That is only strong in a very narrow, academic sense of the word.

          More to the point, it doesn't matter if you want to call it weak or strong. It will cause problems as your site grows and you need to refactor things. If you think ahead and build a strong unit test suite, then it will be less of a problem.

          • Incorrect. Every python object has a type. Different types can often be used interchangeably due to duck typing. What it doesn't have is a static type system - it has a strong, dynamic type system. Unit tests are important in any language, as syntactic checks do not pick up semantic or logic errors. And Python has several linters available that flag potential semantic errors.


            >>> type(1)
            <type 'int'>
            >>> type(int)
            <type 'type'>
            >>> type(type(int))
            <type 'type'

            • Python has an ad-hoc, messy, piece-of-crap type system, which you like for some reason. I don't know why, but I don't judge.

              What is clear is that the type system will cause you problems as your project gets larger a larger, a point which you have not refuted, but is by far the more important point.
    • by Nivag064 ( 904744 ) on Saturday February 09, 2019 @04:29PM (#58095830) Homepage

      Most of the new users since perhaps around 2012 came for the data analytics side.

      IPython, NumPy, SciPy had been around for a while, but with maturing Jupyter, Pandas and TensorFlow/Keras, it really caught on. Other NLP and Machine Learning libraries probably helped too.

      My use of Python today is completely different from how I used it earlier, nearly two decades ago, when it was mainly seen as a better Perl, back when Perl was THE scripting language. Now it is seen as a better MATLAB or a better R, even though the base language isn't itself vectorized as the others. The language and the standard library didn't improve much towards this. It was mainly the third party libraries that emerged and matured.

      Speaking purely from a language standpoint, Julia has all right features for the analytics side, but the scientific community is right now with Python.

      SageMath is free and is easily accessible from Python. It runs on Linux, and other O/S's including those from Microsoft.

      SageMath is very powerful and is a good alternative to MatLab and Mathematica.

      http://www.sagemath.org/ [sagemath.org]
      [...]
      SageMath is a free open-source mathematics software system licensed under the GPL. It builds on top of many existing open-source packages: NumPy, SciPy, matplotlib, Sympy, Maxima, GAP, FLINT, R and many more. Access their combined power through a common, Python-based language or directly via interfaces or wrappers.

      Mission: Creating a viable free open source alternative to Magma, Maple, Mathematica and Matlab.
      [...]

      • by jma05 ( 897351 )

        I had hoped it would succeed more than it did. But somehow, it never quite caught on.
        SageMath did not do for Python what Anaconda did.

        Perhaps, it was (still is? - did not install in a while) the fact that it was distributed as a VM image for Windows.
        With Anaconda, it was easier to setup than plain Python; not even admin rights were needed. The package management was familiar. And it was just Python. SageMath was its own system and was intimidating for new users.

        It also targeted scientists (and I hardly knew

    • It makes sense. Only a few programmers program for the web. But most programmers can make use of data analysis and scripting.

  • by Anonymous Coward

    This seems like it should be obvious. Python would be way way down the list of languages I would use for web development. Python is pretty good at handling text and numbers and I sometimes use the Python interpretor as an advanced command line calculator, so it makes sense for data analysis. But why would I want to use a language like Python for web development? That's like using a dead fish as a hammer.

    • But why would I want to use a language like Python for web development? That's like using a dead fish as a hammer.

      Here's how things worked out: Every web browser in the world comes only with a putrid dead skunk built in, so you have to use the dead skunk as your hammer, even if you'd rather use a dead fish.

    • by jythie ( 914043 )
      Yet, as a Python developer, at least in my area, I get a constant stream of recruiters trying to place me in web development work. They seem to get really confused when I try to explain that I am a python developer but don't do any web work.
  • 93% of respondents said that their activities included Software testing/Writing automated tests

    I guess that's different wording for that the group samples isn't representative for the population at large.

  • The real story is that top US schools are giving rapid paths to Master's and MBA's with a strong focus on data science. These are shortcut degrees and their purpose is to allow those with diploma mill degrees from overseas to come on student visas. Just knock out your micromasters on the cheap online and it knocks out about 25-30% of the requirements for a masters or PhD.

    Why the push for these programs? Because the adjustments to the H1B program emphasize people who hold high US degrees such as a Masters or

  • Seriously. Python looks and feels kinda like octave fortran and is a natural first stop when a person can't afford matlab or other commercial tech options. Needless to say your're talking about number crunching. For web dev esp. now more than ever, why wouldn't you use the language of the web ie. Javascript/nodejs?

"God is a comedian playing to an audience too afraid to laugh." - Voltaire

Working...