Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
Databases Communications Facebook Microsoft Network Networking Software The Internet Twitter Youtube Technology

YouTube, Facebook, Twitter and Microsoft Will Create 'Hash' Database To Remove Extremist Content (reuters.com) 262

bongey writes: Youtube, Facebook, Twitter and Microsoft are teaming up to create a common database to flag extremist videos and pictures. The database is set to go live in 2017. The system will not automatically remove content. Reuters reports: "The companies will share 'hashes' -- unique digital fingerprints they automatically assign to videos or photos -- of extremist content they have removed from their websites to enable their peers to identify the same content on their platforms. 'We hope this collaboration will lead to greater efficiency as we continue to enforce our policies to help curb the pressing global issue of terrorist content online,' the companies said in a statement on Tuesday. Each company will decide what image and video hashes to add to the database and matching content will not be automatically removed, they said. The database will be up and running in early 2017 and more companies could be brought into the partnership."
This discussion has been archived. No new comments can be posted.

YouTube, Facebook, Twitter and Microsoft Will Create 'Hash' Database To Remove Extremist Content

Comments Filter:
  • and tomorrow (Score:5, Insightful)

    by Anonymous Coward on Tuesday December 06, 2016 @08:02AM (#53431707)

    they'll censor whatever the fuck they want to.

    • Re:and tomorrow (Score:5, Insightful)

      by Rockoon ( 1252108 ) on Tuesday December 06, 2016 @08:04AM (#53431723)
      This slope is so slippery that there is no possible way to move any direction but down.
      • Re: (Score:3, Interesting)

        by Zandamesh ( 1689334 )

        This slope is so slippery that there is no possible way to move any direction but down.

        The problem with this reasoning is that it avoids engaging with the issue at hand, and instead shifts attention to extreme hypotheticals. Because no proof is presented to show that such extreme hypotheticals will in fact occur, this fallacy has the form of an appeal to emotion fallacy by leveraging fear. In effect the argument at hand is unfairly tainted by unsubstantiated conjecture.
        source: https://yourlogicalfallacyis.c... [yourlogicalfallacyis.com]

        • Re: and tomorrow (Score:3, Insightful)

          by taskiss ( 94652 )

          And the problem with your reasoning is that content isn't an issue yet you insist it is. Sticks and stones don't exist virtually, it's just bits and bytes.

        • Re:and tomorrow (Score:5, Insightful)

          by Rockoon ( 1252108 ) on Tuesday December 06, 2016 @09:06AM (#53432075)

          The problem with this reasoning is that it avoids engaging with the issue at hand

          The issue at hand is that a bunch of companies are joining forces to control what you are allowed to see, and are starting off with one of the biggest boogie-men available to them as their reasoning for doing it.

          Perhaps you thought that there was a more important issue here?

      • Re:and tomorrow (Score:5, Interesting)

        by Bite The Pillow ( 3087109 ) on Tuesday December 06, 2016 @09:19AM (#53432141)

        So we are back to personal responsibility and vigilance, instead of trusting a free content host not to enforce its terms of service?

        Yawn. It's not censorship, you're playing in their yard, and you are free to start a competitor if it seems like they overstep.

        I'm okay with this until tales of abuses show up, and then I'm judging each side accordingly. Until then, there's nothing to do but spread the information.

        And the first loon to cry censorship is an ignorant ass, not the first of your slippery slope.

        • Re: (Score:2, Insightful)

          by Anonymous Coward

          It is censorship, it's just not illegal censorship. If all major media companies started to censor certain controversial positions, they could certainly shape discourse and have a negative effect on society - there's no reason to not acknowledge that huge potential downside simply because they're presently within their rights to curate what they present to people or help people find.

        • Re:and tomorrow (Score:5, Insightful)

          by Zak3056 ( 69287 ) on Tuesday December 06, 2016 @10:05AM (#53432479) Journal

          Yawn. It's not censorship

          Yet another person who believes "censorship" means "first amendment violation." This is absolutely censorship, though it's "acceptable" because:

          you're playing in their yard, and you are free to start a competitor if it seems like they overstep.

          They're perfectly free to censor their content, it's their house.

          And the first loon to cry censorship is an ignorant ass

          I won't call you an ass, but you are the ignorant party here. That's not something to be proud of.

        • *yawns* Point out ANY definition that defines censorship by WHO does it, and not by the specific actions being done.

          Seriously, if I had a dollar for every time this ignorant statement was made, I'd be one rich mofo.

          Censorship is defined by action, not by who does it. It being acceptable or not is at least partially defined by who does it. It's an elementary difference.
        • When is Social Medias influence on elections and society enough that they should be stewards of free speech? Just like phone companies are stewards by not restricting on political ideological grounds. Or a baker who becomes a steward of protected classes for wedding cakes? We seem to think 'you are a private business and do what you want' until you become a baker exercising religious belief or AT&T that has been determined critical for the nation. If medias influence on the elections are a critical issu

        • I'm okay with this until tales of abuses show up,

          They won't show up, and you'll never see them, so you'll just think everything is fine (until you notice your content has been removed). Which part of "remove content" did you not understand?

        • When so-called 'social media' is the primary place online that people congregate anymore to have discussions and share information, and voluntarily excluding yourself from social media causes you to be left behind and forgotten by most people, then 'social media' arbitrarily deciding what is and is not 'extremist' amounts to violating people's 1st Amendment rights, yes.

          If you were talking to someone on your phone about some hot-button political or social issue and the operator cut in and informed you that
    • they'll censor whatever the fuck they want to.

      Dude, WTF? Wake up. ... It's freakin' FACEBOOK! They can and could always do whatever the f*ck they want! With your content, with your data, ... they could eben change their TOS to allow them to superimpose everyones portrait on animal porn images and there'd be nothing for you to do about it other than delete your account and and all your data and hope that no one downloaded those images to their computer or other parts of the intarweb.

      I'd say FB and Twitter

    • and when they flag trump well they may be like put him back or lose all of there H1B's

    • The problem is some radical views are helpful to society. They are often considered radical because it is demanding a change to a problem that is failed to be recognized. However with "Fake News" we are getting people radicalized over issues that do not exist.
      Like that nut who recently shot up the sandwich shop, because fake news made it seem like they were doing human trafficking from those Evil Democrats.
      Other than blind censoring where the radicalized people just discuss off the grid, and build up thei

      • Like that nut who recently shot up the sandwich shop, because fake news made it seem like they were doing human trafficking from those Evil Democrats. Other than blind censoring where the radicalized people just discuss off the grid, and build up their anger from not feeling the ability to speak their believes. I would like to find some way to flag truthfulness of stories. So we can get a good idea on the nature of the story.

        Well, you can start by not embellishing stories to make a point. The guy that went into Comet Ping Pong fired one shot into the floor, which is bad enough, but your description made it sound like he did lots of damage with multiple gunshots. Should your post be censored as "fake news"? I would flag it "mostly true", since he did fire a shot inside the place. 7 out of 10 for truthfulness, but still misleading.

        Unfortunately I think you'd be hard pressed to find much that fits into the "News - Validated: Ne

    • Except they simply can't effectively censor anything. If spam were an easy problem, it would have been solved in the mid 1990s.

      If they really want to try, then Facebook and Twitter are basically non-players in this game, and the ball is in Youtube (Google's) court to expand its malware protection to include brain malware. But if they ever push too hard, people can just use another browser.

    • by Z80a ( 971949 )

      Censorship on a place like the internet is outright stupid. All you get with it is to move the discussion somewhere else, where generally there are censors for the opposite side, only aggravating the problem immensely.
      The only actual way to combat those said bad ideas is to allow people to freely discuss em.
      Ideas can't be killed with bullets, but they sure can be annihilated by better ideas.

      There is a reason why ISIS etc also are very censorship happy.

    • They can do it today. It's their own networks. They can censor whatever they want. So what? Don't like it, don't use them. The Internet isn't going away.
    • Exactly, precisely this. Who gets to decide what is and is not 'extremist'? And of course there's always going to be someone who decides to slip something into the list that really doesn't belong there, just because they don't think people should see it. "Oh well they're obviously a supporter of {insert political candidate or cause here}, and naturally that's wrong of them, so I should protect the public from their extremist opinions, wouldn't want them poisoning anyone's minds with their nonsense" and voil
    • And we'll sidestep it by changing one single bit at the very end of the video or picture.
  • by GameboyRMH ( 1153867 ) <gameboyrmh@@@gmail...com> on Tuesday December 06, 2016 @08:06AM (#53431733) Journal

    Only 1 bit has to flip to create a mismatch on a cryptographic hash check, and if this system is widespread, doing so will become standard practice.

    • by AmiMoJo ( 196126 )

      Check out Google's reverse image search. It can handle lossy recompression, scaling, contrast/colour changes etc. Their web search can cope with slight changes to text.

      Of course it's not perfect, but they say they will have a human review every post and image, so at least the false positive rate should be fairly low.

      • > cope with slight changes to text.

        That is interesting, for a short enough article, a single comma or letter can switch a article from true to false. Similar with a photo, it will likely match a photo edited to turn a fist into a flip off, or a mirror to make the left hand salute vs right hand, added a nip slip...

        Get your edit close enough to be a match, and you'll ride the positive Karma from the original, or bring the original down with your falsified one.Then again it isn't all that difficult with an

  • So, Youtube, Facebook, Twitter and Microsoft are now the arbiters of what is "extremist" or not. People are stupid. If I worked in the anti-terrorism field I WANT to see these terrorists pictures and videos and find out who posted or accessed them. All that data would go into my database and I would send stormtroopers out regularly to round them up into camps.
    • People are stupid [...] I would send stormtroopers out regularly to round them [terrorists] up into camps.

      Speaking of which...

    • by invid ( 163714 )
      Let the free market do it's job. If social media platforms try to filter out propaganda, create social media platforms that don't filter out propaganda. See which ones the people prefer.
      • The issue is people will choose to go with whomever filters content they don't like and promotes content they do like even if it is wrong.

        Just look at fox entertainment news.

        To be fair MSNBC does the same damn thing.

        • Re: (Score:3, Funny)

          by invid ( 163714 )

          The issue is people will choose to go with whomever filters content they don't like and promotes content they do like even if it is wrong.

          Just look at fox entertainment news.

          To be fair MSNBC does the same damn thing.

          Exactly. And the info bubbles will become info force fields. So you'll have two populations, one that is skewed slightly left of reality, and the other that is skewed to an alternate dimension where Donald Trump is competent enough to be President of the United States. Oh wait, we already have that.

    • I wouldn't want said companies convicting me in a court of law, but controlling the content on their own websites I think they have the right.

  • of everyone who thinks this system will ever only be used to flag and filter " extremist " content.

    While I realize this will be a global system, I'm curious how this will butt heads with the First Amendment in the United States as this will inevitably be a system that will censor information that is embarrassing or uncomfortable to the chosen few who will decide what is " extremist".

    • of everyone who thinks this system will ever only be used to flag and filter " extremist " content.

      While I realize this will be a global system, I'm curious how this will butt heads with the First Amendment in the United States as this will inevitably be a system that will censor information that is embarrassing or uncomfortable to the chosen few who will decide what is " extremist".

      So tired of everyone not understanding what the First Amendment is. Go read it. It's short and sweet. I'll even give you a hint: "Congress shall make no law..."

      • Have you ever read the US (or foreign) antitrust laws? This kind of converted action by dominant market participants -- especially if (as seems likely) they get caught putting anything except terrorist media in the database -- is extremely easy to prosecute as illegal collusion.

        • Have you ever read the US (or foreign) antitrust laws? This kind of converted action by dominant market participants -- especially if (as seems likely) they get caught putting anything except terrorist media in the database -- is extremely easy to prosecute as illegal collusion.

          Yet, as was my point, this has nothing to do with the First Amendment.

      • Would you say that a presidential order restricting speech could act in ways that a Congressional law could not? That would technically avoid violating the 1st, since Congress has made no law. Your general point is correct, that private entities aren't subject to the first amendment directly. But it's important to note that the US constitution is more than just the written document, it is also all the court precedents which surround it. The UK has *no* written constitution the way the US has, it is all prec
        • Would you say that a presidential order restricting speech could act in ways that a Congressional law could not? That would technically avoid violating the 1st, since Congress has made no law. Your general point is correct, that private entities aren't subject to the first amendment directly. But it's important to note that the US constitution is more than just the written document, it is also all the court precedents which surround it. The UK has *no* written constitution the way the US has, it is all precedent and tradition. My point is you don't need to be quite so tired.

          A presidential order restricting speech would have absolutely no force of law (regardless of what Trump may think). I agree whole-heartedly that the US Constitution is more than the words, and includes all the court precedents which surround it. Still, this is not a First Amendment issue and I wish people would get that whenever ZOMG censorship happens.

      • I think you misunderstand. Nowadays, laws are for people, international agreements (TTIP, CETA, etc.) are for companies. Companies do not abide any law, nor do they have to. It's all in the agreements.
    • by dnaumov ( 453672 )

      I'm curious how this will butt heads with the First Amendment in the United States as this will inevitably be a system that will censor information that is embarrassing or uncomfortable to the chosen few who will decide what is "extremist".

      This won't butt heads with the First Amendment in the slightest, because the limitations it applies only applies to government entities, not private ones. You have no right to free speech on somebody else's private platform. They decide the rules and you are free to not use their service.

      • They operate on the infrastructure that is managed by AT&T and the likes that is subsidized by tax payers. A baker is a steward of protected classes for wedding cakes. AT&T are stewards for access to infrastructure. Why are enablers of speech not protecting free speech if we value freedom of speech as a society?

        If Facebook is a soapbox in a town-square, why should they have the right to restrict what is said on that box if it cannot exist without the town-square when we don't even hold the same for

    • I'm curious how this will butt heads with the First Amendment in the United States

      First Amendment doesn't apply in the same way a graffiti artist can't claim a first amendment right to spray paint his thoughts on a privately owned wall.

      The people having content removed are free to set up their own web sites and host whatever content they want. They are not granted the same rights to post whatever they want on someone else's private property.

      • The people having content removed are free to set up their own web sites and host whatever content they want. They are not granted the same rights to post whatever they want on someone else's private property.

        I guess in the same vein that if AT&T restricted access on political ideological grounds, you are free to set up your own lines? Facebook and others can't exist without the infrastructure that is subsidized by tax payers. Why are enablers of speech not stewards of speech like a baker is a steward to protected classes for wedding cakes? Last I checked, wedding cakes don't have the same impact on our elections as these enablers of speech do if Obama and the media are to be believed with their 'fake news'

        • Rights of the private owner. Facebook owns Facebook's servers.

          There is a company called Lamar around here that runs a bunch of billboards. Should I be allowed to paint over their billboards with a message of my choice?

          The answer is no, not without their permission.. Even though government pays for the roads that one uses to access those billboards.

          Facebook's servers are their property it's their billboards. You and I do not have a right to post whatever we want there. It's private property.

          • It's private just like a baker restricting their service on religious grounds until the government steps in and then the baker becomes a steward of rights for protected classes. Would you be okay with restrictions on access to phone lines on ideological grounds from AT&T? If enabling conversation on ideological neutral infrastructure is important, how is that different on the AT&T fiber lines vs Facebook servers? Why is AT&T forced to adopt civic responsibility but Facebook does not when Faceboo

  • by phamNewan ( 689644 ) on Tuesday December 06, 2016 @08:12AM (#53431773) Journal
    My guess is that pretty soon they will create a Social Credit Score like China is putting in place. Then anyone who disagrees can instantly be silenced online. http://www.wsj.com/articles/ch... [wsj.com]
  • Tell me how this is any different than what China does, then. You might as well have a Ministry of Truth.
    • by coinreturn ( 617535 ) on Tuesday December 06, 2016 @08:21AM (#53431827)

      Tell me how this is any different than what China does, then. You might as well have a Ministry of Truth.

      I'll be glad to tell you the difference. In China, the censorship is from the government; this article is referring to private businesses. Clear enough?

      • AT&T is a private company too, we still dictated free speech terms to it by force. Once you reach a certain threshold of users, common carrier rules should apply.
        • No, we didnt. It was symbiotic relationship that AT&T entered willingly. Forcing common carrier rules, would actually infringe on the ISP's free speech. They are free to carry whatever they wish.

        • Once you reach a certain threshold of users, common carrier rules should apply.

          That sounds like an issue of having clear rules. By all means might I redirect you to the US Congress website? I'm pretty sure that if the people who said they're tired of rules with the clarity of mud actually did something about that issue we might start getting lawmakers that actually thought out legislation rather than the typical knee jerk. But both the issue of people doing something about it and intelligent lawmakers are just wishful thinking.

      • In China, the censorship is from the government; this article is referring to private businesses. Clear enough?

        As the Jakov Smirnoff joke goes, "In Soviet Union, the government controls the corporations".

      • by dmt0 ( 1295725 )

        Tell me how this is any different than what China does, then. You might as well have a Ministry of Truth.

        I'll be glad to tell you the difference. In China, the censorship is from the government; this article is referring to private businesses. Clear enough?

        In China government is from government, here government is done by private business.

        Fixed that for ya.

      • I'll be glad to tell you the difference. In China, the censorship is from the government; this article is referring to private businesses. Clear enough?

        Yeah, the government has nothing to do with this: https://tech.slashdot.org/stor... [slashdot.org]

        Keep on keeping on. Critical thought is not required in order to live.

        What was the difference again? Oh right. One government person can not arbitrarily decide something can be censored, like in China. It has to be a group of government people. All the difference in the world.

    • Tell me how this is any different than what China does, then. You might as well have a Ministry of Truth.

      That's kind of an easy assignment, don't you think?

      The Chinese government censors. If you don't use their filters, they view that as circumvention and reserve the right to force you to use the filter.

      The listed companies, on the other hand, would use a word like "competition" instead of "circumvention." They totally and completely lack the ability to censor, and in fact don't even have the mindset and

  • by sjbe ( 173966 ) on Tuesday December 06, 2016 @08:18AM (#53431811)

    I'm sure many of you have had the same thought but there is no way in hell this would be used merely for "extremist" content.

    First off good luck consistently defining extremist. Sometimes it's obvious but sometimes it's a matter of perspective. There is no bright line test.

    Second, sometime "extreme" viewpoints are merely sane ones being suppressed by another group. Fifty years ago people arguing peacefully for civil rights for minorities were considered "extremist" by our own government.

    Third, you know for a fact that what this will actually be used for is cross site protection of copyrighted material that has nothing to do with any extreme viewpoints because the technology has more than one use. But it's easy to develop it to ostensibly combat "extremism" and then quietly use it for other purposes.

    • I'm sure many of you have had the same thought but there is no way in hell this would be used merely for "extremist" content.

      If said companies overstep their bounds customers are free to form rival websites that are not run by over zealous individuals.

      • If said companies overstep their bounds customers are free to form rival websites that are not run by over zealous individuals.

        Ok go ahead and start a company that will supplant Google. Good luck with that. Back here in the real world we understand that market forces do not solve every problem and in fact it market forces are the source of many of them. You are being very glib with a non-solution to a very real problem.

        • There is not currently a good business case to try and "supplant Google". If google were to sufficiently anger the masses, people would be actively looking for an alternative and a business case would exist.

          In this case, absolutely, market forces solve the problem. Just like the famous case of Ford only selling black cars. "Who will replace the behemoth Ford and sell colourful cars?"

          As it turned out, lots of people, it sold and Ford had to follow suit. If Google were to become a pariah not delivering wh

  • Hashes...? Darwin In Action. Your human evolutionary selection will faver bad speling from now on. No! We mean URLs! +#hastTagWarz ?Add=aField&Remove=uniqueIDpowerfjonrfoijnqrf&Remove=ArticleSelector free speech collateral damage resulting in, "An unexpected censorship error has occurred. No one is available to figure out why Life Sucks, but the suckage sure eats a lot of money an effort. Just like cell phones... swallow.

    • I think more likely, Twitter et al will simply be driving away users if they use this ability too much, and they will then start to go the way of the New York Times.
  • by rmdingler ( 1955220 ) on Tuesday December 06, 2016 @08:24AM (#53431849) Journal
    They're already doing it:

    Twitter suspended 235,000 accounts between February and August this year and has expanded the teams reviewing reports of extremist content.

    This is merely a mechanism to share what one mega-company has found "extreme" with another.

    If we're really lucky, this will cause some folks to (shudder) lose a bit of respect for these places people spend their lives.

  • by MinistryOfTruthiness ( 1396923 ) on Tuesday December 06, 2016 @08:27AM (#53431867) Homepage Journal

    So any network gets to censor something, and they automatically censor it across other networks! I love it! ...As long as I get to drive.

    • According to the summary it doesn't automatically remove content on other networks, so no.

      It flags content for the owners of the other networks to review to see if they agree it should be removed.

  • by deecemobile ( 4774761 ) on Tuesday December 06, 2016 @08:39AM (#53431925)
    Say goodbye to free speech on the internet. This all started because democrats lost the Presidency and painted "fake" news as the scapegoat. Who will decide what constitutes "fake" news? Google, Facebook, etc - giant left-leaning entities that have massive control over people's internet experience and the information they access. I can see dissenting view points increasingly characterized as "fake" and effaced.
    • These three companies primarily want
      - to continue to make money from us, by showing they're paying attention, and
      - to not get thrown in jail.

      I expect, like Lauren Weinstein (http://factsquad.com, https://lauren.vortex.com/2016... [vortex.com]), that labelling fake news will be the most likely approach. That avoids the jail problem (:-))

      To ensure they look "fair", I suspect that crowd-sourcing is the way theywill get leads, but not how the initial decision to label will be made. I expect them to do a sort --un

      • by NetNed ( 955141 )
        Yes, they are going to get "thrown in jail" for having a result of a website that someone deems "fake". So are they going to not have any of the major media outlets on their sites also? Because I see PLENTY of fake, native ad stories on the mainstream sources all the time. You can spot them when they are fluff pieces that mention specific brand names for no reason. By the way, this isn't Canada and comparing the two is no even reliant. Canada still kisses the ass of a monarchy thousands of miles across a se
    • by DogDude ( 805747 )
      These companies have nothing to do with free speech. You can say all you want on the Internet. Whether anybody else will give a shit or hear you is another question, altogether.
  • Good, this is the step that will make them (Google, FB, Twitter, MS) irrelevant as a fact based system and people will stop using them. It is about time that somebody did something about biased opinions of the MSM. I just didn't expect them to do it to themselves.

    I am sure that someone will take up the true ideology of freedom of speech that will still provide unbiased information which is what is needed.

    • by DogDude ( 805747 )
      The retards might quit using it. They'll head over to places like Breitbart and Infowars. So what? Nothing of value is lost. These people certainly aren't advertisers. They're not even great to advertise *to* unless you're selling some kind of scam. Let 'em go. If anything, it'll make more money for FB/Google/MS/Twitter et all.
    • Can you make meaningful amounts of ad money on your webpage if you've been blacklisted out of Google, FB, and MS's networks?
      • by DogDude ( 805747 )
        Sure, I can. Why not? Newspapers and magazines have been doing it for hundreds of years.

        Besides, what do advertising networks have to do with anything?
  • But will it work with Isis videos?

  • So basically, we are starting to implement China's form of censorship. Want to protest? Top visiting sites that censor this way. Facebook, for example, is hardly a necessity. Part of free speech is figuring out phoney from fact. Besides, what's to say that what they label as "true" isn't approved propaganda? It's always easy to invent justifications for censorship. In the USA, there is one against it the NSA continues to ignore: The Constitution.
  • This is why I've migrated to gab.ai and infogalactic.com. These hashes are the start for censoring anything they deem inappropriate, including political dissident discourse. Twitter has already banned thousands of users for posting anti-islamic content even though it's fact based.

    We need open platforms if we expect to have freedom of expression. Hate speech can be re-defined until it covers anything they want.

    Leave big social media, don't produce content for them. Embrace new open platforms.

  • Lets bring censorship to facebook, linked.in and Youtube, because in the Internet age, they are the only way of sending extremist videos.
  • I get that people want terrorist content to be censored. There are obvious moral, ethical, and political problems with such censorship, and they are being thoroughly debated in other threads here. But I think we need to ask some deeper questions. Why are citizens of ostensibly free nations, (such as America), so drawn to becoming fundamentalist terrorists that we have to try to 'cover their eyes' with censorship? And why are fundamentalists in Muslim countries SO angry with the 'infidels' that they are will

    • by DogDude ( 805747 )
      Deep and wide-spread currents of dissatisfaction run at the root of terrorism's growth. We need to acknowledge the tremendous psychological pressures that lead to terrorism, and we need to begin healing the social, political, and spiritual disenfranchisement that our societies create. A good place to start would be in our schools, with promoting the principles of individualism, autonomy, open-mindedness, compassion, and the Golden Rule. A generation raised on these values just might stop pissing off other n

Some people manage by the book, even though they don't know who wrote the book or even what book.

Working...