MCPcopy
hub / github.com/doug-martin/goqu

github.com/doug-martin/goqu @v9.19.0 sqlite

repository ↗ · DeepWiki ↗ · release v9.19.0 ↗
2,928 symbols 17,404 edges 124 files 622 documented · 21%
README
  __ _  ___   __ _ _   _
 / _` |/ _ \ / _` | | | |
| (_| | (_) | (_| | |_| |
 \__, |\___/ \__, |\__,_|
 |___/          |_|

GitHub tag Test Go Reference codecov Go Report Card

goqu is an expressive SQL builder and executor

If you are upgrading from an older version please read the Migrating Between Versions docs.

Installation

If using go modules.

go get -u github.com/doug-martin/goqu/v9

If you are not using go modules...

NOTE You should still be able to use this package if you are using go version >v1.10 but, you will need to drop the version from the package. import "github.com/doug-martin/goqu/v9 -> import "github.com/doug-martin/goqu"

go get -u github.com/doug-martin/goqu

Migrating Between Versions

Features

goqu comes with many features but here are a few of the more notable ones

  • Query Builder
  • Parameter interpolation (e.g SELECT * FROM "items" WHERE "id" = ? -> SELECT * FROM "items" WHERE "id" = 1)
  • Built from the ground up with multiple dialects in mind
  • Insert, Multi Insert, Update, and Delete support
  • Scanning of rows to struct[s] or primitive value[s]

While goqu may support the scanning of rows into structs it is not intended to be used as an ORM if you are looking for common ORM features like associations, or hooks I would recommend looking at some of the great ORM libraries such as:

Why?

We tried a few other sql builders but each was a thin wrapper around sql fragments that we found error prone. goqu was built with the following goals in mind:

  • Make the generation of SQL easy and enjoyable
  • Create an expressive DSL that would find common errors with SQL at compile time.
  • Provide a DSL that accounts for the common SQL expressions, NOT every nuance for each database.
  • Provide developers the ability to:
  • Use SQL when desired
  • Easily scan results into primitive values and structs
  • Use the native sql.Db methods when desired

Docs

  • Dialect - Introduction to different dialects (mysql, postgres, sqlite3, sqlserver etc)
  • Expressions - Introduction to goqu expressions and common examples.
  • Select Dataset - Docs and examples about creating and executing SELECT sql statements.
  • Insert Dataset - Docs and examples about creating and executing INSERT sql statements.
  • Update Dataset - Docs and examples about creating and executing UPDATE sql statements.
  • Delete Dataset - Docs and examples about creating and executing DELETE sql statements.
  • Prepared Statements - Docs about interpolation and prepared statements in goqu.
  • Database - Docs and examples of using a Database to execute queries in goqu
  • Working with time.Time - Docs on how to use alternate time locations.

Quick Examples

Select

See the select dataset docs for more in depth examples

sql, _, _ := goqu.From("test").ToSQL()
fmt.Println(sql)

Output:

SELECT * FROM "test"
sql, _, _ := goqu.From("test").Where(goqu.Ex{
    "d": []string{"a", "b", "c"},
}).ToSQL()
fmt.Println(sql)

Output:

SELECT * FROM "test" WHERE ("d" IN ('a', 'b', 'c'))

Insert

See the insert dataset docs for more in depth examples

ds := goqu.Insert("user").
    Cols("first_name", "last_name").
    Vals(
        goqu.Vals{"Greg", "Farley"},
        goqu.Vals{"Jimmy", "Stewart"},
        goqu.Vals{"Jeff", "Jeffers"},
    )
insertSQL, args, _ := ds.ToSQL()
fmt.Println(insertSQL, args)

Output:

INSERT INTO "user" ("first_name", "last_name") VALUES ('Greg', 'Farley'), ('Jimmy', 'Stewart'), ('Jeff', 'Jeffers') []
ds := goqu.Insert("user").Rows(
    goqu.Record{"first_name": "Greg", "last_name": "Farley"},
    goqu.Record{"first_name": "Jimmy", "last_name": "Stewart"},
    goqu.Record{"first_name": "Jeff", "last_name": "Jeffers"},
)
insertSQL, args, _ := ds.ToSQL()
fmt.Println(insertSQL, args)

Output:

INSERT INTO "user" ("first_name", "last_name") VALUES ('Greg', 'Farley'), ('Jimmy', 'Stewart'), ('Jeff', 'Jeffers') []
type User struct {
    FirstName string `db:"first_name"`
    LastName  string `db:"last_name"`
}
ds := goqu.Insert("user").Rows(
    User{FirstName: "Greg", LastName: "Farley"},
    User{FirstName: "Jimmy", LastName: "Stewart"},
    User{FirstName: "Jeff", LastName: "Jeffers"},
)
insertSQL, args, _ := ds.ToSQL()
fmt.Println(insertSQL, args)

Output:

INSERT INTO "user" ("first_name", "last_name") VALUES ('Greg', 'Farley'), ('Jimmy', 'Stewart'), ('Jeff', 'Jeffers') []
ds := goqu.Insert("user").Prepared(true).
    FromQuery(goqu.From("other_table"))
insertSQL, args, _ := ds.ToSQL()
fmt.Println(insertSQL, args)

Output:

INSERT INTO "user" SELECT * FROM "other_table" []
ds := goqu.Insert("user").Prepared(true).
    Cols("first_name", "last_name").
    FromQuery(goqu.From("other_table").Select("fn", "ln"))
insertSQL, args, _ := ds.ToSQL()
fmt.Println(insertSQL, args)

Output:

INSERT INTO "user" ("first_name", "last_name") SELECT "fn", "ln" FROM "other_table" []

Update

See the update dataset docs for more in depth examples

sql, args, _ := goqu.Update("items").Set(
    goqu.Record{"name": "Test", "address": "111 Test Addr"},
).ToSQL()
fmt.Println(sql, args)

Output:

UPDATE "items" SET "address"='111 Test Addr',"name"='Test' []
type item struct {
    Address string `db:"address"`
    Name    string `db:"name" goqu:"skipupdate"`
}
sql, args, _ := goqu.Update("items").Set(
    item{Name: "Test", Address: "111 Test Addr"},
).ToSQL()
fmt.Println(sql, args)

Output:

UPDATE "items" SET "address"='111 Test Addr' []
sql, _, _ := goqu.Update("test").
    Set(goqu.Record{"foo": "bar"}).
    Where(goqu.Ex{
        "a": goqu.Op{"gt": 10}
    }).ToSQL()
fmt.Println(sql)

Output:

UPDATE "test" SET "foo"='bar' WHERE ("a" > 10)

Delete

See the delete dataset docs for more in depth examples

ds := goqu.Delete("items")

sql, args, _ := ds.ToSQL()
fmt.Println(sql, args)
sql, _, _ := goqu.Delete("test").Where(goqu.Ex{
        "c": nil
    }).ToSQL()
fmt.Println(sql)

Output:

DELETE FROM "test" WHERE ("c" IS NULL)

Contributions

I am always welcoming contributions of any type. Please open an issue or create a PR if you find an issue with any of the following.

  • An issue with Documentation
  • You found the documentation lacking in some way

If you have an issue with the package please include the following

  • The dialect you are using
  • A description of the problem
  • A short example of how to reproduce (if applicable)

Without those basics it can be difficult to reproduce your issue locally. You may be asked for more information but that is a good starting point.

New Features

New features and/or enhancements are great and I encourage you to either submit a PR or create an issue. In both cases include the following as the need/requirement may not be readily apparent.

  1. The use case
  2. A short example

If you are issuing a PR also include the following

  1. Tests - otherwise the PR will not be merged
  2. Documentation - otherwise the PR will not be merged
  3. Examples - [If applicable] see example_test.go for examples

If you find an issue you want to work on please comment on it letting other people know you are looking at it and I will assign the issue to you.

If want to work on an issue but dont know where to start just leave a comment and I'll be more than happy to point you in the right direction.

Running tests

The test suite requires a postgres, mysql and sqlserver databases. You can override the connection strings with the MYSQL_URI, PG_URI, SQLSERVER_URI environment variables*

go test -v -race ./...

You can also run the tests in a container using docker-compose.

MYSQL_VERSION=8 POSTGRES_VERSION=13.4 SQLSERVER_VERSION=2017-CU8-ubuntu GO_VERSION=latest docker-compose run goqu

License

goqu is released under the MIT License.

Extension points exported contracts — how you extend this code

DeleteSQLGenerator (Interface)
An adapter interface to be used by a Dataset to generate SQL for a specific dialect. See DefaultAdapter for a concrete i [6 …
sqlgen/delete_sql_generator.go
SelectSQLGenerator (Interface)
An adapter interface to be used by a Dataset to generate SQL for a specific dialect. See DefaultAdapter for a concrete i [6 …
sqlgen/select_sql_generator.go
TruncateSQLGenerator (Interface)
An adapter interface to be used by a Dataset to generate SQL for a specific dialect. See DefaultAdapter for a concrete i [6 …
sqlgen/truncate_sql_generator.go
UpdateSQLGenerator (Interface)
An adapter interface to be used by a Dataset to generate SQL for a specific dialect. See DefaultAdapter for a concrete i [6 …
sqlgen/update_sql_generator.go
InsertSQLGenerator (Interface)
An adapter interface to be used by a Dataset to generate SQL for a specific dialect. See DefaultAdapter for a concrete i [6 …
sqlgen/insert_sql_generator.go
ExpressionSQLGenerator (Interface)
An adapter interface to be used by a Dataset to generate SQL for a specific dialect. See DefaultAdapter for a concrete i [6 …
sqlgen/expression_sql_generator.go
Aliaseable (Interface)
Interface that an expression should implement if it can be aliased. [11 implementers]
exp/exp.go
DbExecutor (Interface)
nolint:stylecheck // keep name for backwards compatibility [3 implementers]
exec/query_factory.go

Core symbols most depended-on inside this repo

Equal
called by 802
internal/util/value_slice.go
From
called by 668
exp/exp.go
ToSQL
called by 650
exp/exp.go
Where
called by 572
exp/exp.go
NewColumnListExpression
called by 358
exp/col.go
NewIdentifierExpression
called by 327
exp/ident.go
SetFrom
called by 208
exp/select_clauses.go
Eq
called by 198
exp/exp.go

Shape

Method 2,081
Function 553
Struct 203
Interface 66
TypeAlias 25

Languages

Go100%

Modules by API surface

exp/exp.go196 symbols
exp/select_clauses.go97 symbols
select_dataset_example_test.go91 symbols
select_dataset.go89 symbols
expressions_example_test.go88 symbols
select_dataset_test.go83 symbols
database.go78 symbols
sqlgen/expression_sql_generator_test.go74 symbols
exp/update_clauses.go59 symbols
exp/insert_clauses.go59 symbols
internal/util/reflect_test.go58 symbols
exp/select_clauses_test.go54 symbols

Used by 1 indexed graphs manifest dependencies, hub-wide

Dependencies from manifests, versioned

github.com/lib/pqv1.10.1 · 1×
github.com/mattn/go-sqlite3v1.14.7 · 1×
golang.org/x/cryptov0.0.0-2019060512303 · 1×

Datastores touched

goqupostgresDatabase · 1 repos
(mysql)Database · 1 repos

For agents

$ claude mcp add goqu \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact