puerkitobio / goquery Goto Github PK

View Code? Open in Web Editor NEW

13.6K 253.0 910.0 543 KB

A little like that j-thing, only in Go.

License: BSD 3-Clause "New" or "Revised" License

Go 62.10% Shell 0.27% Roff 37.63%

selector-strings jquery html-parsing goquery

goquery's People

Contributors

Stargazers

Watchers

Forkers

sunfmin funkygao metakeule polaris1119 luxyer dunmatt matrixik escribano caojiguang raphaelkimmig ebfe bestng mjason liudch jcswart noahshen timcubb pope assassingj moretti sethwklein iscr jweir insionng gabrielrios francisfussiger wtmmac terrancy asdf20122012 langzime rli-diraryi chenfeng2478 elvin-du linphy xiaozhen1900 tennessine jamesjiangchn mrxiaoz lazytiger chenshanghe bqw5189 zhwzhang knightingal aybabtme butland omni360 curvesoft is00hcw nuaays kingpro archs nosix-me comdex freeeve no2key satoshun karbanfeynman jshi-git luosangnanka lnx1337 niltonkummer jmoiron bozzcq hu17889 yuyongwei yuheinakasaka nivertech holin grengojbo pilgrim2go gfoxiii thatguystone puma007 bruce2008github yogyrahmawan asappinc gsh45 ideamean deweerdt suifengrock mkamakura cashlo jpillora dimshadowww loulou886 sinelpan yelinaung sheran foursigma lonelypale mnhkahn mewbak gameogre pombredanne zumur gomapsdev zhuweijava mechanoid mantyr liwp-stephen

goquery's Issues

How to read from file?

What if I have already downloaded an HTML file locally and want to parse it?

Based on the main example, I tried:

if doc, e = goquery.NewDocument("file://somefile.html"); e != nil {
    log.Fatal(e)
}

But it gives:

2014/06/20 17:05:04 Get file://somefile.html: unsupported protocol scheme "file"
exit status 1

match by attribute

Would it be possible to match by attribute?

Timeout property on goquery.NewDocument

Is there a property that I can pass that if I haven't received a response in so many seconds to return an error?

'*goquery.Document' to 'io.Reader'

This isn't an issue; it's an idea/feature request. It'd be cool if there were a way to convert a goquery.Document type to an io.Reader type. The NewDocumentFromReader function does the reverse. A NewReaderFromDocument function would be cool too.

"Newbier" Example?

Hey there! Nice job with this package.

I'm a newcomers to go so I thought I'd most humbly submit my example I'd use to show others. It's just easier to copy and paste this example into a test.go file and simply run it (for complete beginners).

package main

import (
  "fmt"
  "log"
  gq "github.com/PuerkitoBio/goquery"
)

func ExampleScrape() {
  var doc *gq.Document
  var e error

  if doc, e = gq.NewDocument("http://metalsucks.net"); e != nil {
    log.Fatal(e)
  }

  doc.Find(".reviews-wrap article .review-rhs").Each(func(i int, s *gq.Selection) {
    band := s.Find("h3").Text()
    title := s.Find("i").Text()
    fmt.Printf("Review %d: %s - %s\n", i, band, title)
    })
}

func main() {
  ExampleScrape()
}

Question about attributes

Hi,

I have HTML element:

[input onkeypress="if(event.keyCode == 13){processHash('Search')}" class="jq-zoho-search-input" type="text" id="searchInputBox" accesskey="f" title="Search jQuery" name="search"]

There is way to get all atributes of selected element ? I am expecting to get:

onkeypress="if(event.keyCode == 13){processHash('Search')}"
class="jq-zoho-search-input"
type="text"
id="searchInputBox"
accesskey="f"
title="Search jQuery"
name="search"

I know that there is function Attr, but I want all them in one list.. I select element and run function GetAttributes (for example) and I get list of attributes..

Is this possible with current version of GoQuery ? I can't find it..

GoDoc comments still mention the old exp/html package

It depends on Go's experimental html package, which must be installed so that it can be imported as "code.google.com/p/go.net/html". See this tutorial on how to install it accordingly: http://code.google.com/p/go-wiki/wiki/InstallingExp

Unable to install exp/html

I'm new to go so I'm not having much luck here.

You refer to the https://code.google.com/p/go-wiki/wiki/InstallingExp page for installing the experimental libraries however I think this page has changed since you wrote your instructions. Also, the given example on that page also does not work.

I think that the HTML package may have been moved outside of experimental? I'm not familiar enough with Go to know or not. Either way, I cannot get goquery installed.

gopath for sub-repository

sed -i 's|"code\.google\.com/p/go\.|"golang.org/x/|' $(find . -name '*.go')

How do we handle the new path for go.html?

https://groups.google.com/forum/#!topic/golang-nuts/eD8dh3T9yyA

go get can‘t got newest code

At winXP i386, get old code, it's not have NewDocumentFromReader()

How to add attr to a node?

Can give a example about the question?

Why no New from a Reader or String?

I am using goquery to scan existing HTML files. These aren't created from a response. And I don't want to expose go.net/html to my application.

A NewFromString or NewFromReader would be great... or just a simple New

func New(src io.Reader) (d *Document, e error){
    // Parse the HTML into nodes
    root, e := html.Parse(src)
    if e != nil {
        return
    }

    // Create and fill the document
    d = newDocument(root, nil)
    return
}

BTW nice library, thank you very much.

Can i remove a selection's child selection?

some jquery selectors not supported by query

eg. ":first" ":eq(3)" :lt :gt and so on

Getting video src?

Sorry for the newb question, Learning go and trying to extract the mp4 from a vine link. I'm trying to follow the example, and extract the "src" attribute from the "video" html tag, but I get a

'# command-line-arguments
./main.go:17: multiple-value s.Find("video").Attr() in single-value context

error when running, I was wondering if I need to select the Attribute a different way?

package main

import (
  "fmt"
  "log"

  "github.com/PuerkitoBio/goquery"
)

func getMP4URL() {
  doc, err := goquery.NewDocument("https://vine.co/v/MlWtKgwh7WY")
  if err != nil {
    log.Fatal(err)
  }

  doc.Find(".vine-video-container").Each(func(i int, s *goquery.Selection) {
    mp4 := s.Find("video").Attr("src")
    fmt.Printf("MP4 %d: %s\n", i, mp4)
  })
}

func main() {
  getMP4URL()
}

url change in readme

Hi,

In readme ==> GoQuery's complete godoc reference documentation can be found here.

Change destination URL from:

http://go.pkgdoc.org/github.com/puerkitobio/goquery

To:

http://go.pkgdoc.org/github.com/PuerkitoBio/goquery

because link is pointing to wrong location.. where no documentation can be found..

please :)

Modifying (XML) file

This actually is a question; I was wondering,

Will goquery work on arbitrary XML files?
Is it possible to alter an attribute in the document?

Update exp/html dependency

Now in go.net package:

https://groups.google.com/forum/?fromgroups=#!topic/golang-nuts/Qq5hTQyPuLg

Can't build inside a container

Im trying to build this package inside a container:

Step 8 : RUN go get github.com/PuerkitoBio/goquery ---> Running in e81d2861928f
# github.com/PuerkitoBio/goquery
gopath/src/github.com/PuerkitoBio/goquery/filter.go:116: cannot use sel.Nodes (type []*"code.google.com/p/go.net/html".Node) as type []*"golang.org/x/net/html".Node in argument to cs.Filter
gopath/src/github.com/PuerkitoBio/goquery/filter.go:116: cannot use cs.Filter(sel.Nodes) (type []*"golang.org/x/net/html".Node) as type []*"code.google.com/p/go.net/html".Node in return argument
gopath/src/github.com/PuerkitoBio/goquery/filter.go:120: cannot use s.Get(0) (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to cs.Match
gopath/src/github.com/PuerkitoBio/goquery/query.go:20: cannot use s.Nodes[0] (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to cs.Match
gopath/src/github.com/PuerkitoBio/goquery/query.go:22: cannot use s.Nodes (type []*"code.google.com/p/go.net/html".Node) as type []*"golang.org/x/net/html".Node in argument to cs.Filter
gopath/src/github.com/PuerkitoBio/goquery/traversal.go:105: cannot use n (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to cs.Match
gopath/src/github.com/PuerkitoBio/goquery/traversal.go:385: cannot use c (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to sel.MatchAll
gopath/src/github.com/PuerkitoBio/goquery/traversal.go:385: cannot use sel.MatchAll(c) (type []*"golang.org/x/net/html".Node) as type []*"code.google.com/p/go.net/html".Node in append
2014/11/06 15:01:48 The command [/bin/sh -c go get github.com/PuerkitoBio/goquery] returned a non-zero code: 2

Wondering if anyone can give me some inisght ?

why i cannot install exp/html ?

when i excute go get github.com/PuerkitoBio/goquery ,i get an error says :imports exp/html : unrecognized import path "exp/html".

Select fails for elements with multiple classes

CJK encoding support

when html head include charset=gbk, the Text() return not correct.

Don't change   to space in Html()

I'm trying to split a string using the   entity. This works with Jsoup for Java, but here it gets changed to a normal space, making what I want to do impossible.

how to remove a node?

selection does not have a remove method?

thank you for your job:)

Incorrect parse

Hi, I got a problem when parsing the website:

<title>Saturday Night Live: The Best of Chris Kattan (2004)</title>
Saturday Night Live: The Best of Chris Kattan (2003) (TV)
Now Playing
Movie/TV News
My Movies
DVD/Video
IMDbTV
Message Boards
Showtimes & Tickets
IMDbPro
IMDb Resume
Login | Register
Home |
Top Movies |
Photos |
Independent Film |
GameBase |
Browse |
Help
All
Titles
\- TV Episodes
My Movies
Names
Companies
Keywords
Characters
Quotes
Bios
Plots
more |
tips
SHOP SATURDAY...
Amazon.com
Amazon.ca
Amazon.co.uk
Amazon.de
Amazon.fr
DVDVHSCDAll
DVDVHSCDAll
DVDVHSCDAll
DVDVHSCDAll
DVDVHSCDAll
IMDb >
Saturday Night Live: The Best of Chris Kattan (2003) (TV)
Quicklinks
main detailscombined detailsfull cast and crewcompany creditsuser commentsuser ratingsrecommendationsplot keywordsmovie connectionsrelease dates
Top Links
-trailers
-full cast and crew
-trivia
-official sites
-memorable quotes
Overview
main details
-combined details
-full cast and crew
-company credits
-tv schedule
Promotional
-taglines
-trailers
-posters
-photo gallery
Awards & Reviews
-user comments
-external reviews
-newsgroup reviews
-awards
-user ratings
-recommendations
-message board
Plot & Quotes
-plot summary
-plot keywords
-Amazon.com summary
-memorable quotes
Fun Stuff
-trivia
-goofs
-soundtrack listing
-crazy credits
-alternate versions
-movie connections
-FAQ
Other Info
-merchandising links
-box office/business
-release dates
-filming locations
-technical specs
-laserdisc details
-DVD details
-literature listings
-news articles
External Links
-showtimes
-official sites
-miscellaneous
-photographs
-sound clips
-video clips
Saturday Night Live: The Best of Chris Kattan (2003) (TV)
advertisement
photos
board
trailer
details
Register or login to rate this title
User Rating:
4.8/10
(57 votes)
more
Release Date:
27 September 2003 (USA)
more
Genre:
Comedy more
Plot Keywords:
Character Name In Title
User Comments:
Lets get physical
more
(Credited cast)Chris Kattan ... Various Characters (archive footage)more
Runtime:
USA:76 min
Country:
USA
Language:
English
Color:
Color
MOVIEmeter:
16% since last week
why?
Company:
Broadway Video
more
Movie Connections:
Spoofs The Lord of the Rings: The Two Towers (2002)
more
This FAQ is empty. Add the first question.
(Comment on this title)
1 out of 1 people found the following comment useful:-
Lets get physical, 12 November 2005
Author:
Chip_douglas from Rijswijk (ZH), The Netherlands
Chris Kattan might well be the greatest physical comedian they ever had
on Saturday Night Live. Only Jim Carrey's work on "In Living Color"
surpasses him. Like Carrey, Kattan is the kind of comedian that you
either love or hate. Or you might love him at first but eventually
he'll get on your nerves. Kattan also has this gay stigma hanging over
his head, hindering a successful movie career like Carrey and
Groundlings pal Will Ferrell. At least for now. This compilation opens
with the first appearance of the Roxbury Guys, when Will and Chris were
just trying out the idea and had not even found Haddaway's 'What is
Love' to head-bop to. This made me expect some more Roxbury dancing
later on in the show, but no such luck.His many recurring characters appear one by one, including one of the
most elaborate Mango skits they ever did (Mango vs. J-lo), Suel
Forrester in court, the Zimmermans at Halloween (Chris and Cheri Oteri
are a great match) and that other pair of dancing brothers, the
DeMarco's, auditioning for Bon Jovi. For some reason Jovi seems to drag
out the ending long past the stage of being funny. When it comes to his
most energetic and far out character of all, I would not have picked
the Mr. Peepers skit with Kevin Spacey as the best one. The ones with
The Rock and Tom Hanks were much funnier. Besides, I think they edited
it somewhat. My absolute favourite in this collection has to be the
'How do you say? Ah Yes! Show' with Antonio Banderas and Jennifer Love
Hewitt.During a montage of celebrity impressions it becomes clear Kattan is
not the best mimic on the show, but his take on Pacino is absolutely
hilarious. The White trash couple is pretty disgusting, especially when
Amy Poehlerwants to suck his toe-thumb (don't ask). As usual Fred
Armisen steals the show in the Buddy Mills sketch, and when they get to
Goth Talk, it's the one where his character Azrael Abbys is pretending
to be dead. Well I guess he was always more of a sidekick in that one
anyway. There are three clips from Weekend update, one with Norm and
two with Jimmy and Tina. Kattan's first appearance as Gollum is
actually taken from the Superbowl Half-time show. It ends with the
Siamese twins skit with Jennifer Garner that has Chris playing a
normal, boring straight guy. I guess they had to reinforce that image
one last time. Either that or it was an excuse to have more Jimmy
Fallon in there. They should have put in another round of Roxbury if
you ask me.9 out of 10
Was the above comment useful to you?
more
Discuss this title with other users on IMDb message board for Saturday Night Live: The Best of Chris Kattan (2003) (TV)
If you enjoyed this title, our database also recommends:
A Bug's Life
Meet the Parents
Keeping the Faith
The Opposite of Sex
The Big Kahuna
IMDb User Rating:
IMDb User Rating:
IMDb User Rating:
IMDb User Rating:
IMDb User Rating:
Add a recommendation |
Show more recommendations
You may report errors and omissions on this page to the IMDb database managers. They will be examined and if approved will be included in a future update. Clicking the 'Update' buttonwill take you through a step-by-step process.
Home | Search | Now Playing | News | My Movies | Games | Boards | Help | US Movie Showtimes | Top 250 | Register | RecommendationsBox Office | Index | Trailers |
Jobs | IMDbPro.com - Free Trial | IMDb Resume
Copyright © 1990-2007 Internet Movie Database Inc.
Terms and Privacy Policy under which this service is provided to you.
An company.
Advertise on IMDb.
License our content.

Back to Movie index

The golang code is like this:

for _, n := range doc.Find("body").Children().Not("style").Not("script").Nodes {
          buf.WriteString(getNodeText(n))
}

What I finally get is only the "Back to Movie index". I dont quite understand why.

In .Each func how “return”

doc.Find("dl[class='brand_tree'] dd ul li").Each(func(index int, s *goquery.Selection) {
brandLiId, exists := s.Attr("id")
if exists == false {
return // End "Each" ?
}

//......
})

.Find Error "invalid memory address or nil pointer dereference"

panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x8 pc=0x459f16]

goroutine 5196 [running]:
github.com/PuerkitoBio/goquery.funcÂ·008(0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /Users/jinke/golang/src/github.com/PuerkitoBio/goquery/traversal.go:383 +0x46
github.com/PuerkitoBio/goquery.mapNodes(0xc2091358f0, 0x1, 0x1, 0x2afca5fda5f8, 0x0, ...)
        /Users/jinke/golang/src/github.com/PuerkitoBio/goquery/traversal.go:532 +0x8f
github.com/PuerkitoBio/goquery.findWithSelector(0xc2091358f0, 0x1, 0x1, 0x718dd0, 0x25, ...)
        /Users/jinke/golang/src/github.com/PuerkitoBio/goquery/traversal.go:389 +0x8d
github.com/PuerkitoBio/goquery.(*Selection).Find(0xc208006660, 0x718dd0, 0x25, 0xc2000b3000)
        /Users/jinke/golang/src/github.com/PuerkitoBio/goquery/traversal.go:27 +0x45
main.qiche4sListSpider(0xc2000aca40, 0x2, 0xc20487e400, 0x32, 0x1512, ...)
        /Users/jinke/golang/src/cds_spider/price/main/bitauto.go:195 +0x406
main.funcÂ·005(0x1, 0xc2007fe180)
        /Users/jinke/golang/src/cds_spider/price/main/bitauto.go:165 +0x20e
github.com/PuerkitoBio/goquery.(*Selection).Each(0xc20125a480, 0x2afca5fdadb8, 0x25)
        /Users/jinke/golang/src/github.com/PuerkitoBio/goquery/iteration.go:7 +0xf7
main.qiche4sSpider(0xc2000aca40, 0x1447, 0x6b80f0, 0x0, 0x1512, ...)
        /Users/jinke/golang/src/cds_spider/price/main/bitauto.go:166 +0x5e5
main.funcÂ·008(0xc2000aca40, 0x1447, 0x6b80f0, 0x0, 0x1512, ...)
        /Users/jinke/golang/src/cds_spider/price/main/bitauto.go:263 +0xb6
created by cds_spider/price/frame.(*Frame).Start
        /Users/jinke/golang/src/cds_spider/price/frame/frame.go:116 +0x29c

code :

193  root, _ := html.Parse(res.Body)
194  document := goquery.NewDocumentFromNode(root)
195  selections := document.Find("div[class='lm_subprice_blc'] table tr")
196  if selections.Size() == 0 {
197         //.....
198         return
199  }

Will it be "root, _ := html.Parse(res.Body)" wrong here ?
update:

root, err := html.Parse(res.Body)
if err != nil {
//.......
 return
}

Make regexp a package-level variable

https://github.com/PuerkitoBio/goquery/blob/master/query.go#L47

SetAttr only updates existing attributes, it should also create them

I had a look at your tests and you're only testing updating attributes. I confirmed this with:

package main

import (
    "fmt"
    "strings"

    "github.com/PuerkitoBio/goquery"
)

func main() {

    doc, _ := goquery.NewDocumentFromReader(strings.NewReader(`
        <html>
        <body>
            <input id="foo" placeholder="123"/>
        </body>
        </html>
    `))

    doc.Find("#foo").SetAttr("value", "bar").SetAttr("placeholder", "456")

    out, _ := doc.Html()

    fmt.Print(out)
}

$ go run example.go
<html><head></head><body>
            <input id="foo" placeholder="456"/>


    </body></html>

the result don't matches the selector string.

e.g.

...
doc.Find("img[src]")
...

< img src="assets/images/gallery/thumb-1.jpg" alt="150x150"/> is ok
< img alt="150x150" src="assets/images/gallery/thumb-1.jpg" /> will not match

RemoveAttr function and RemoveNode function

If I want to modify a document, then RemoveAttr and RemoveNode is needed.

find input is nil ~~~

uri = "http://www.google.com"
doc, e := goquery.NewDocument(uri)
if e != nil {
    beego.Error(e)
}
form := doc.Find("input").Each(func(j int, input *goquery.Selection) {
        println(input.Html())
    })

the input is nil~~, help~~~

Deleting element from DOM

Hi,

I can't solve one thing..

I have selection:

[h1 class="title"]
Some kind of titlte [a href="url" class="encore"][span class="comm red"][/span][/a]
[/h1]

selecting element:

sel := dom.Find(h1[class=title])

then

sel = sel.Not(a)

after this I am expecting that element "a" will be removed with all childs

then I call

html, _ = sel.Html()
fmt.Println(html)

and I get title and "a" element with it..

probably I am doing something wrong, in my case I need to remove elements from my selection

thanks

Bug /usr/lib/go/src/pkg/code.google.com/p/go.net/html/token.go:289: undefined: io.ErrNoProgress

Bug
root@go-hacking:~/gocrawl# go get github.com/PuerkitoBio/goquery

code.google.com/p/go.net/html

/usr/lib/go/src/pkg/code.google.com/p/go.net/html/token.go:289: undefined: io.ErrNoProgress

OS:
Linux go-hacking 3.2.0-4-amd64 #1 SMP Debian 3.2.46-1+deb7u1 x86_64 GNU/Linux

NewDocumentFromString?

I saw this: #20 for NewDocumentFromReader . I could also really use NewDocumentFromString... I have the unfortunate responsibility to "clean" some html and resave that is in an XML pseudo-RSS feed. So by time I get down to the parts I'd need to manipulate the html I'm within a loop of strings.

Got an error when executing go get

After executing go get github.com/PuerkitoBio/goquery, I got following prompt:

abort: code.google.com certificate error: certificate is for *.googleusercontent.com, *.blogspot.com, *.bp.blogspot.com, *.commondatastorage.googleapis.com, *.doubleclickusercontent.com, *.ggpht.com, *.googledrive.com, *.googlesyndication.com, *.sandbox.googleusercontent.com, *.storage.googleapis.com, blogspot.com, bp.blogspot.com, commondatastorage.googleapis.com, doubleclickusercontent.com, ggpht.com, googledrive.com, googleusercontent.com, static.panoramio.com.storage.googleapis.com, storage.googleapis.com
(configure hostfingerprint 70:03:d2:44:35:d0:d4:64:85:f0:3e:c8:15:9c:4d:e7:59:91:50:0d or use --insecure to connect insecurely)
package github.com/PuerkitoBio/goquery
    imports code.google.com/p/cascadia: exit status 255

I'm a newbie to Golang. Could anyone tell me how to fix it? Thanks!

exp/html api changed, causing cascadia to fail, causing goquery to fail

the exp/html api must've changed, since cascadia relies on functions that don't exist anymore.

Here's some terminal printouts for your pleasure:

$ go get github.com/PuerkitoBio/goquery                                                                                                                                              
# code.google.com/p/cascadia                                                                                                                                                                                                                  
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:18: n.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                                   
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:30: n.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                                   
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:70: n.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                                   
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:257: n.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                                  
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:274: n.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                                  
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:354: parent.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                             
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:399: parent.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                             
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:419: n.FirstChild undefined (type *html.Node has no field or method FirstChild)                                                                                                  
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:465: n.PrevSibling undefined (type *html.Node has no field or method PrevSibling)                                                                                                
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:468: n.PrevSibling undefined (type *html.Node has no field or method PrevSibling)                                                                                                
/usr/local/go/src/pkg/code.google.com/p/cascadia/selector.go:468: too many errors

It doesn't work when there's more than one class value in a class property delimited by a space.

...

User-Agent

Can we a way of configuring the user-agent?
I'm getting problems recently because of it :(

NextWhile function?

I see NextUntil and NextFilteredUntil, which are awesome. Is there a way to select the next elements while they match a certain selector? For example, I know I need to select a bunch of <p> elements but I don't know what the next non-p tag will be, so I don't know what to put in for "until".

If there isn't a way to do this currently, would you like me to try implementing this and submitting a pull request?

How to use the library? Can you give more examples demonstrate?

undefined: goquery.Selection

Are the docs outdated?

When running an Each statement such as the following,

r.Doc.Find("form").Each(func(i int, form *goquery.Selection) {

}

gives me undefined: goquery.Selection.

It seems to return *goquery.Node instead, which then means that I can't call .Find() on the form object.

What am I overlooking?

How to find html attribute whose value begins with a number?

Say the html document I'm parsing has the attribute class="1post". Is there a way to use the Find() function for this class? If I run doc.Find(".1post"), I get this error:
panic: expected identifier, found 1 instead

This might be a cascadia issue. Do you know of a way around it?

imported and not used: "github.com/PuerkitoBio/goquery" but undefined

When i run $ go run main.go

I got this :
# command-line-arguments
./main.go:5: imported and not used: "github.com/PuerkitoBio/goquery"
./main.go:9: undefined: NewDocument
./main.go:13: undefined: doc

The file main.go is the example.
I adjust it in order to run it outside.
I added package main and the corresponding import (import "github.com/PuerkitoBio/goquery").
Before this i run go get github.com/PuerkitoBio/goquery

Package can't be `go get`

Hello, I'm using your package as a testing library in my project, but starting of today my builds started to fail. The CI logs print the following error:

# github.com/PuerkitoBio/goquery
../../PuerkitoBio/goquery/filter.go:116: cannot use sel.Nodes (type []*"code.google.com/p/go.net/html".Node) as type []*"golang.org/x/net/html".Node in argument to cs.Filter
../../PuerkitoBio/goquery/filter.go:116: cannot use cs.Filter(sel.Nodes) (type []*"golang.org/x/net/html".Node) as type []*"code.google.com/p/go.net/html".Node in return argument
../../PuerkitoBio/goquery/filter.go:120: cannot use s.Get(0) (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to cs.Match
../../PuerkitoBio/goquery/query.go:20: cannot use s.Nodes[0] (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to cs.Match
../../PuerkitoBio/goquery/query.go:22: cannot use s.Nodes (type []*"code.google.com/p/go.net/html".Node) as type []*"golang.org/x/net/html".Node in argument to cs.Filter
../../PuerkitoBio/goquery/traversal.go:105: cannot use n (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to cs.Match
../../PuerkitoBio/goquery/traversal.go:385: cannot use c (type *"code.google.com/p/go.net/html".Node) as type *"golang.org/x/net/html".Node in argument to sel.MatchAll
../../PuerkitoBio/goquery/traversal.go:385: cannot use sel.MatchAll(c) (type []*"golang.org/x/net/html".Node) as type []*"code.google.com/p/go.net/html".Node in append
FAIL    github.com/9uuso/vertigo [build failed]

I tried using different Go versions, but the command seems to fail on at least Go 1.2, 1.3 and 1.3.1.

doc.Html()

doc.html() will return the string wrapped by html struct.How can I just to string, no html tag,head tag...

Are there any method to create an empty Selection?

Can I use Select{nil, nil, nil} ?

Text()

First I would like to thank you for your code, it eases my life 👍

Issue I got

Source page is as follow:

<html>
<head>
<meta http-equiv="Content-Language" content="en-us">
<meta http-equiv="Content-Type" content="text/html; charset=windows-1252">
<title>Test page</title>
</head>
<body>
<h1>This is the Test page for a crawler</h1>
<p>Before getting the Admission of.</p>
</body>
</html>

doc.Find("body").Children().Not("style").Not("script").Text() gave me the result:
This is the Test page for a crawlerBefore getting the Admission of

Why is crawler and Before not seperated? I think it should not be the problem of windows-1252. Maybe something is wrong? I have not read through the source code yet.

how can get elements by name?

<input type="hidden" name="size" value="S">

tks

can run js within html?

can run js and handle DOM or BOM? ajax is import for web2.0